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ABSTRACT 

This study investigated instructional leadership 
functions and school policy factors that affected implementation of 
instructional strategies presented in a research-based staff 
development program for secondary school mathematics teachers in 
school districts in the Chicago suburbs. The instructional leadership 
functions included the amount and sources of support teachers 
received in their efforts to improve instruction. School policy 
factors included the workload assigned to teachers and the school's 
instructional supervision and evaluation procedures. A second 
objective was to test the effectiveness of the training provided in 
the staff development program by analyring teacher participation, 
distribution of class time across various instructional functions, 
and student engagement in the learning process. After an introductory 
chapter setting forth the research problem and objectives, the four 
remaining chapters provide (1) an extensive review of the pertinent 
literature on instruction, staff development, instructional 
leadership, evaluation, and teacher workload; (2' an in-depth 
description of the research methodology; (3) data analysis; and (4) a 
discussion, based on findings, of staff development program 
effectiveness and organisational conditions for instruction**! 
improvement, along with recommendations for future research. I *r 
appendixes provide instrumentation from the study. (TE) 
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Chapter One 
Research Problea and Objectives 

Statement of Purpose 

The purpose of this study was to Investigate Instructional leadership 
functions and school policy factors that affected the extent to which 
teachers implemented instructional strategies presented In a research-based 
staff development program ior secondary school mathematics teachers. The 
Instructional leadership functions studied Included the amount and sources of 
support teachers received In their efforts to Improve Instruction. School 
policy factors that were considered Included the workload assigned to 
teachers and the school's Instructional supervision and evaluation 
procedures* Our study examined the relationship between variations In these 
factors and the extent of Implementation of the recommended teaching 
strategies contained In the staff development program* 

A second objective was Co test the effectiveness of the training 
provided In the staff development program designed for the project* The 
content of the training program was based on findings from research on 
instructional practices related to classroom management functions and on 
elements of Instructional design* Moreover, the training activities provided 
in the staff development program were also research-based, and their design 
reflected research-baped staff development practices known to be effective In 
terms of the extent to which they were implemented* 

The model' 8 effectiveness was assessed by analyzing the extent to 
which the participating teachers who participated applied the teaching 
strategies recommended In the program, the differences In the distribution of 
class time across various instructional functions, and the degree of the 
students" engagement in the learning process* 
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The research project was conducted under the auspices of the Center 
for Educational Policy and Management (CEPM) at the University of Oregon* It 
was designed to address areas of study outlined In CEPM's Program on 
Secondary School Organization and the Program on Staff Development* The 
focus of our project was directly related to the central Issues In both 
programs, namely, the relationship of Instructional leadership functions and 
school policies to the Implementation of staff development programs In 
secondary schools. 

The Problem 

Since the release of A Nation at Risk (National Commission on 
Excellence In Education 1983). education analysts have delivered a "rising 
tide of reform reports" (Cross 1984) to the education community* These 
analysts based their reports on research studies that employed varied 
approaches to Investigating the schooling process, and their recommendations 
have led to a unanimous call for strengthening the quality of the education 
our schools provide* 

Perhaps the most troubling of the concerns these reports cited were 
those related to the teaching and learning processes that prevail In high 
schools. For example. Theodore Slzer (1984). in his study of American 
secondary schools. ^ -ports that the vast majority of high school students 
appear to be content with satisfying minimum expectations for their academic 
performance. Furthermore, he characterizes most high school students' 
classroom behavior as passive and docile and notes that students are rarely 
engaged In any instructional activities that require more than rote 
memorization. 

Recent studies have also Indicated that high school teaching methods 
often do not resemble those that research on teaching effectiveness has 



identified as contributing most to Improved student achievement. Writing of 

the status of the effective schools movement in high schools, Farrar, 

Neufleld, and Miles (1984) make this assessment: 

Program developers report that secondary teachers use 
teaching and management methods that are more traditional 
than those used by elementary teachers — either because 
secondary teachers have not been exposed to the innovative 
practices of the last decade or because they have not found 
these practices useful. For example, mastery learning Is a 
rare approach in high schools. ... To Implement effective 
school programs, high school teachers will have to learn new 
approaches, not fine-tune familiar practices. 

Based on his observations in a nationwide sample of more than 1,000 
classroous, Goodlad (1983) also describes a kind of "bland sameness" In the 
instructional strategies teachers employ. He noted that the teachers he 
observed had a limited repertoire of pedagogical alternatives and, 
specifically, that feedback and corrective learning activities designed to 
help students understand and correct their learning errors were almost 
nonexistent in most of the teachers' instructional designs. Furthermore, he 
found little evidence of any collaborative efforts among teachers and 
administrators to Improve Instruction. 

In light of these findings, Goodlad argues that the school's culture 
must encourage and support alternative Instructional Ideas. He believes that 
schools can achieve this goal by providing more opportunities for teachers to 
become Involved In research-based staff development programs. In addition, 
he stresses the critical function that instructional leadership can play In 
creating conditions that foster and facilitate successful staff development 
efforts. Goodlad notes that when the school establishes these conditions and 
provides staff development programs targeted at Improving Instruction, 
teachers often respond eagerly to alternative teaching methods. 

Yet, despite the promise of improved Instruction that effective staff 
development programs offer, it appears that most schools have not 



enthusiastically embraced this method for achieving school Improvement. In 
the Gall et al* (1982) review of the literature on effective Inservlce 
practices and their subsequent analysis of existing staff development 
programs, they found widespread discrepancies between those programs 
currently offered as professional growth activities for teachers and the 
kinds of programs that research has shown to be effective la promoting staff 
development* Tley report that "current Inservlce education appears to 
consist largely of unlntruslve, comfortable experiences that reinforce 
prevailing patterns of school work* Experiences that seek to Improve school 
work against measured criteria are uncommon 91 (p. 122) • 

During the past decade, research on Instruction and the research on 
effective staff development practices have significantly advanced efforts to 
strengthen the Instructional Improvement process* Yet research findings In 
these two areas have not been meaningfully linked or consistently applied In 
any systematic fashion to most staff development programs currently offered 
to secondary school teachers* Our study hypothesized that teaching and 
learning performance In high schools could be Improved If teachers were 
offered a staff development program that combined the findings from both 
these areas of research* Moreover, the study hypothesized that the 
effectiveness of staff development programs Is strengthened when teachers are 
provided with support from their colleagues and the Instructional leaders of 
the school, and when school policies enhance, rather than hinder, the 
Instructional Improvement process* 

We tested these hypotheses by assessing the effects of a staff 
development model for secondary school mathematics teachers that was based on 
the findings from caearch on teaching and on effective Inservlce practices* 
The program's effectiveness was tested by measuring the degree to which 
teachers Implemented the research-based Instructional strategies the program 
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contained. In addition, our investigation explored the relationships between 



the extent of implementation and several other factors related to the school 
environment. Specifically, we sought to answer the following questions: 

1. Did the teachers who participated in the staff development program 
Implement the recommended teaching behaviors to a greater extent 
than did the nonpartlclpatlng teachers? 

2. Did a relationship exist between the extent to which the 
participating teachers implemented the recommended instructional 
strategies and a) the amount and sources of colleglal and 
administrative support the teachers reported receiving in their 
efforts to improve instruction, b) the instructional supervision 
and evaluation practices their schools employed, and c) the 
teachers" workload? 



Chapter Two 
Review of the Literature 



Tills chapter reviews research on Instruction and on staff development 
practices. Findings from these areas of research are discussed In terms of 
their relationship to the staff development model designed for and 
field-tested In this study. In addition, the chapter surveys the research on 
Instructional leadership and on school policies concerning teacher evaluation 
procedures and teacher workloads. 



Research on Instruction 

According to Bloom (1981), a major revolution In educational research 
has taken pLice during the past decade. He considers the central feature of 
this revolution to be the shift In research away from the elements that are 
s title In the teaching and learning process toward those elements that can be 
altered. 

One of the alterable elements Bloom Identifies is the amount of time 
students spend engaged in their learning, as opposed to the fixed amount of 
time allocated for Instruction. Research on teacher effectiveness indicates 
that when teachers employ certain classroom management and organisational 
strategies, their students spend more time engaged In their learning 
(Anderson, Evertson, and Brophy 1978; Berliner, Fisher, Fllby, and Marllave 
1978; Emmer and Evertson 1980; Fltzpatrlck 1982; Good and Grouws 1977; 
Stalllngs 1980). These findings suggest that teachers' managerial decisions 
can have a direct Impact on the amount of time devoted to teaching and 
learning. Consequently, If teachers use effective management techniques the 
amount of learning time that occurs In classrooms can be positively altered 
regardless of the amount of time allocated to Instruction. 
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A second alterable Instructional component Bloom (1968) Identifies is 
the use of formative testing and corrective procedures within the 
Instructional design* The use of formative tests that provide students with 
feedback on their learning progress and that specify corrective procedures 
they should follow for remediation of their learning errors Is, perhaps, the 
chief characteristic that distinguishes mastery learning Instruction from 
conventional Instruction* When the teacher Incorporates formative testing 
and corrective feedback Into the instructional plan, the gains In student 
learning are considerable* Over the past decade, research and development 
efforts In mastery learning have provided compelling evidence of the positive 
Impact that the mastery learning process has on student achievement (Block 
1974, 1979; Block and Anderson 1975; Bloom 1968, 1976, 1981, 1984; Guskey 
1980, 1981, 1984; Guskey and Gates 1985)* Recent analyses of the effects of 
mastery learning Indicate that the mean achievement score of students 
receiving corrective feedback falls at the 83rd percentile on control group 
distributions (Walberg and Lysakowski 1982)* 

In addition to these findings, recent reviews of findings from 
teacher effectiveness research (i*e*, Rosenshine 1983, Walberg and Lysakowski 
1982) also emphasise the l*3portance of the Instructional principles of 
mastery learning, particularly the use of feedback and corrective stategles* 
Yet, despite this abundance of evidence, these instructional strategies are 
Infrequently employed in most classrooms* For example, the classroom 
observation data that Goodlad and his associates (1983) reported Indicate 
that less than 2 percent of Instructional time in secondary classrooms Is 
devoted to providing students with feedback related to their progress in 
learning and to the correction of their learning errors* 

The reason that teachers rarely apply Instructional principles of 
mastery learning in high school Instruction may be that they are pressured to 
° 7 
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••cover" content, a requirement that often conflicts with the goal of 
assisting students to attain mastery of their learning* In most high school 
classrooms, teachers resolve this conflict by letting content coverage take 
precedence over content mastery* Slo»**ng down the pace or diminishing the 
scope of Instruction by setting aside class time for feedback and corrective 
activities is considered to be too great a price to pay for implementing 
mastery learning* 

The staff development program developed and tested In this study was 
specifically designed to minimise the time costs of mastery learning by 
maximizing the use of Instructional time to the fullest advantage* The 
program focused on the positive alteration of both instructional time and 
formative testing practices* The Intent of the program was to enable 
teachers to capitalise on the amount of time available for learning in two 
ways: first, by employing research-based classroom management and 
organizational strategies that increase the proportion of time actually u«?d 
for Instructional purposes and, second, by Incorporating the instructional 
principles of mastery learning within this additional amount of time 
available for learning* In short, the program's content combined 
instructional practices drawn from research findings on classroom management 
and mastery learning* 

Research on Staff Development 

Most research on effective inservlce practices has examined two major 
components related to the design of staff development models: first, the 
selection of the curriculum or content of the program and, second, the design 
of training activities the program provides* With respect to the content of 
staff development programs, It is clear thr.t the findings from the teacher 
effectiveness research can contribute to Improved programs* However, 
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findings from the research on staff development (I.e. f Colaradarcl and Gage 
1984) have consistently Indicated that simply providing teachers with access 
to research-based instructional strategies is not sufficient to alter 
existing patterns of the teaching/learning process. These findings suggest 
that the u*slgn of the training activities Included In staff development 
programs must provide teachers with both Intensive and extensive 
opportunities to Incorporate the desired instructional strategies into their 
teaching repertoires. 

Lawrence and Harrison's (1980) met -(-analysis cf lnservlce practices 
indicated that effective staff development programs Incorporate opportunities 
for teachers to receive guided practice and feedback within intensive 
training programs. Similarly, In their review of research on Implementation 
of effective teaching strategies, Fullan and Pomfret (1977) reported that 
guided practice and feedback are essential components of successful staff 
development programs. Furthermore, the research findings of Jo> *e ; -id 
Showers (1981) underscore the effectiveness of extensive staff development 
tralulng programs that consistently provide support and follow-up activities. 
They recommend that staff development programs Include intensive training In 
and demonstrations of the desired instructional strategies 9 as well as guided 
practice, feedback, and coaching in the application ot the strategies. 

Providing the opportunity for teachers to discuss the application of 
effective teaching practices recommended in training sessions is also an 
Important component of successful staff development programs. In the I/D/E/A 
study of school change, Bentzen (1974) reported that greater Improvements In 
performance occurred when teachers discussed their instructional concerns and 
engaged In problem-solving activities. The training programs Evertsoft, 
Emmer, Sanford, and Clements (1982) designed Include time for teachers to 
discuss the application of the effective managerial strategies; and these 



programs 9 too, have been found to help teachers Improve their classroom 
management and organization. Finally, the Effective Use of Time Program 
designed by Stalling! (1980) provides extensive opportunities for teachers to 
exchange Ideas and to consider In a colleglal setting the solutions to 
teaching/learning problems* 

Effective staff development models should also provide teachers with 
the opportunity to observe each others' classrooms* Research has shown that 
peer observation Is highly effective In helping teachers to become more aware 
of their own Instructional behavior and to Improve their ability to analyze 
the teaching process* In their study of colleglal evaluation* Roper, Deal, 
and Dornbusch (1976) reported a significant improvement In teaching 
performance for those teachers who were given the opportunity to observe each 
other* German and McLaughlin (1978) also cited peer observation as a 
requisite component for successful change efforts. 

Further evidence on the importance of peer observation is provided by 
Sparks (1983)* Her comparison of three staff development models Indicated 
chat the greatest Improvements in teaching performance occurred in a group 
that attended workshops and participated peer observations, as compared to 
a group that participated only in the 1 ' ops and a group that attended the 
workshops and receive 1 individual coaching from a trainer* in discussing her 
findings, Sparks noted that the peer observ* tlon process provided teachers 
with object^e feedback on thexr Instructional performance* This information 
was then analyzed, and appropriate changes or modifications were suggested, 
based upon the effective teaching practices contained in the training 
program* In addition, teachers also benefited from observing one another 
because it gave them the opportunity to view another teacher In action, 
which, in turn, provided them with new Ideas and strategies for implementing 
effective teaching practices in their own classrooms* 
° in 
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Despite the fact that the number of experimental studies on staff 
development Is still relatively small, the findings from these studies are 
most encouraging. In his review of the literature on the effects of 
Inservice education, Gall et al. (1982) noted that those studies that have 
employed an experimental design have clearly demonstrated the positive 
effects of Inservice education on the capacity of teachers to Improve their 
students' achievement. The experimental studies they cited In their review 
Include those conducted by Stalllngs (1980); Anderson, Evertson, and Brophy 
(1976); Good and Grouws (1977); and Crawford et al. (1978). In each of these 
studies one group of teachers participated in a training program. Following 
the training period, program effects were measured by assessing the extent to 
which teachers' Implemented the teaching strategies recommended In the 
training program and by measuring the Improvement in their students' 
performance. Each of these programs was designed to encourage teachers to 
use strategies that previous research had found to correlate positively with 
Improvement In student achievement. The outcomes of these studies Indicated 
that teachers in the treatment group employed the recommended Instructional 
strategies to a far greater extent than teachers not so trained, and the rate 
of academic engaged time and level of achievement of students whose teachers 
received training was significantly higher than it was In the control 
classrooms. 

In summary, research on Inservice practices has begun to provide a 
framework for instructional Improvement through staff development. Findings 
from inservice research have yielded a set of guidelines for the design of 
effective staff development programs. These guidelines were applied to the 
selection of the content and to the design of the staff development program 
conducted In thie study. A complete description of the program Is given In 
Chapter 3. 
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Instructional Leadership Support Functions 

The importance of the relationship between instructional leadership 
and the quality of instruction has been underscored in numerous school 
effectlvness studies (i.e., Purkey and Smith 1982, Edmonds 1979, Rutter et 
al. 1979). Some of these studies have described instructional leadership as 
the process of carrying out a set of functions that facilitate instructional 
improvement* This research perspective, which does not restrict leadership 
analysis to the personal and stylistic characteristics that distinguish 
successful instructional leaders from leas effective ones, Is similar to the 
recent shift lu emphasis In research on teacher effectiveness from an 
analysis of the characteristics of effective teachers to the study of the 
components of the Instructional process* These new lines of inquiry, in both 
the research on Instructional leadership and on teaching, appear to hold a 
greater promise of Identifying the key Ingredients that lead to instructional 
improvement. 

Research on dissemination efforts supporting school Improvement 
highlights the importance of effective instructional leadership* Berman and 
McLaughlin's (1978) study of the implemeutatlon of federally funded 
instructional improvement projects strongly suggests that these Improvement 
programs were relatively successful because they received substantial 
administrative support* Similarly, St filings and Mohlman (1981) Indicated 
that, In their study, the greatest Improvements in Instructional behavior 
occurred in those schools where the principals provided assistance and 
support to the teachers* Likewise, in their synthesis of the research on 
improving schools, Lleberman and Miller (1981) emphasized the Importance of 
the principal's role In providing instructional support that facilitates 
Improved teaching performance* 

12 
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Despite the fact that a clearer definition of Instructional 
leadership could be obtained If research In this area focused on the 
behaviors and function* of effective principals, to date only a few studies 
have done so* Martlnko, Yukl, and Marshall's (1983) research review revealed 
that little attention has been given to the behaviors or characteristics that 
distinguish effective secondary principals from less effective principals In 
terms of their roles as Instructional leaders* Similarly* Daresh and Liu 
(1985) found only a limited acount of research that Investigates the specific 
behaviors of Instructional leaders at any level* 

Despite the paucity of such research, recent studies on Instructional 
leadership have Identified certain distinct support functions that are 
essential to Improved Instruction* In De Bevolse's (1983) review of the 
research on the principal as Instructional leader, she highlighted a set of 
leadership functions that consistently appear in the research literature. 
Among the functions that principals should emphasize are: communicating a 
vision of the school's purposes and standards, monitoring student and teacher 
performance, recognising and rewarding good work, and providing effective 
staff development programs* 

In a related area, Russell, White, and Maurer (1984) studied the 
functions of Instructional leadership by using the "critical incident" 
technique to link the behaviors and activities of secondary school principals 
to scnool effectiveness* After completing a lengthy and rigorous 
verification process, they narrowed the number of Identified behaviors from 
1,038 to 337* They then classified the behaviors according to their 
relationship to eight characteristics derived from a review of effective 
schools literature* Both effective and ineffective principal behaviors were 
Identified for each characteristic* Figure 2-1 summarizes their findings* 

O 13 
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Figure 2-A 
Instructional Leadership for Teachers 



Effective Behaviors 



A* Takes an active role In planning, conducting, 

Implementing, and evaluating lnservlce training 
B. Provides direction and support for Individual 

teachers to eliminate poor instructional performance 
Cm Provides direct Instructional leadership In one-on-one 

Interactions with Individual teachers 
D* Make 8 sure specifics of each teacher's classroom 

performance are evaluated 
Em Hires an effective staff 

Ineffective Behaviors 

A* Does not provide effective feedback on Instructional 
skills 

B* Denies importance of lnservlce programs 

Cm Does not provide adequate classroom evaluation 

Dm Hires teachers without an emphasis on teaching 

performance 
Em Does not require teacher Improvement 

(Source: Russell et al* 1985, p. 8) 

Bauchner and Loucks" (1982) study on the role of building 

administrators In the instructional Improvement process has also provided 

some clues to effective Instructional behavior* Their study indicated tliat 

the amount of assistance teachers reported receiving from principals when 

implementing new practices was related to three conditions: 1) the perceived 

benefits teachers attribute to the use of the practices, 2) mastery of the 

related Instructional strategies, and 3) fidelity In applying the practices* 

Cox (1983) has categorized the types and conditions of support teachers In 

his study reported receiving from their principals* She found that teachers 

felt they were receiving support when: 

- all instructional staff were aware that the successful 
implementation of the practice was a top priority 

- requisite materials were available 

- teachers had ready access to personnel within or 
outside the district who knew about and were 
experienced with the practice 
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• teachers were given tine to actually use the practice 
through help with classroom scheduling and through 
facilitating schoolwlde scheduling 

• the schoolwlde climate was conducive to continuous, 
systematic problm solving 



- teachers understood the expectation that all the 
components of the practice were to be Implemented 

- teachers had the freedom to determine the means they 
would employ to meet the expectations 

- teachers, parents , and central administrators were 
working In a realistic time frame and did not feel 
pressured by premature evaluations* 

Gersten and Carnlne (1981) have further articulated the notion of 

Instructional support functions. They Identified six Instructional 

leadership functions that promote Instructional Improvement. They believe 

Instructional leaders should: 

- use programs of known effectiveness 

- demonstrate visible commitment to the program 

- provide emotional support and incentives to teachers 
implementing the program 



- monitor student achievement 

- monitor instructional performance 

- provide teachers with specific, concrete technical 
feedback and assistance. 

Gersten and Carnine argue that it Is essential that these functions 

are fulfilled; however, principals need not be the only Instructional leaders 

In the schools. Rather, they found that supervisors and teachers can perform 

this set of support functions just as well or better than principals. In 

another study of principal behaviors, Pltner and Charters (1984) also argued 

that the functions of Instructional leadership need not be carried out solely 

by the principal. 

Little (1982) has advanced a similar perspective on the Issue of 
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support for Instructional Improvement* She also believes that teachers and 
administrators should share responsibility for fulfilling Instructional 
leadership functions and that this sharing may be the best means of realising 
and sustaining significant Improvement of Instructional performance* 

Although the result * of studies on Instructional leadership have 
consistently Indicated a strong and positive relationship between 
Instructional leadership functions and school effectiveness, most research 
has used descriptive and correlational designs* However* Gall and his 
associates (1984) recently carried out an experimental Investigation of the 
Impact of Instructional leadership skills on Instructional improvement and 
found that Involving principals In a staff development program Increased 
Implementation of the program's objectives, The researchers concluded that 
If principals assume a more active Instructional leadership role, they can 
selectively direct teachers' attention to particular Instructional 
Improvement objectives and can help teachers maintain Improvement over time* 

Our study provided a further Investigation Into the relationship 
between Instructional support functions anu teachers' efforts to Improve 
their Instructional practices* Our research Is similar to the research of 
Gall and his associates In that they both provided principals and other 
administrators with training in effective ways to fulfill their role as 
Instructional leaders* The present study Is also similar to the research of 
Bauchner and Loucks (1982)* The teachers participating in their study were 
asked to report on the support they had received from their principals while 
they Implemented the teaching strategies presented In the staff development 
program* Our study also asked teachers to supply such Information. However, 
rather than limiting teachers' responses to the amount and types of support 
they had received from their principals, as In the Bauchner and Loucks study, 
we explored a broad range of supportive behaviors and added several other 
° 16 
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potential sources of support* Both the administrators' training program and 
a description of the measures employed to assess the amount and sources of 
support that the teachers received when Implementing the research-based 
Instructional strategies Included lb the staff development program are 
described In Chapter 3. 



Instructional Supervision and Evaluation Procedures 

Previous research on instructions supervision and teacher evaluation 
has provided evidence that a relatlonshli exists between certain dimensions 
of the supervisory process * id teacher internalization of the process. 
Because our study Investigated similar relationships, a brief review of the 
literature on this topic is useful. 

Natrlello' s (1984) review of research on instructional supervision 
examined the relationship between teachers' Internalization of the evaluation 
process and two factors related to the process, namely , the frequency of 
evaluations they received and the amount of Influence they had over the 
supervisory process. In his analysis, Natrlello Included two Important 
indicators of teacher internalization of evaluation processes: 1) the extent 
to which teachers believed the supervisory process helped Improve their 
performance and 2) the amount of leverage they reported having over their own 
performance. Leverage, as Natrlello defines it, refers to "the relationship 
between the effort put forth by a performer and the outcomes that result from 
that effort." Thus, In the case of assessing leverage over Instructional 
performance, teachers were requested to assess the Impact of their efforts to 
Improve instruction on their students' learning achievements. Natrlello 
found that both Indicators of teacher Internalization of the evaluation 
process — helpfulness of the supervisory procedures and leverage— were based 
upon teachers' perceptions of their own Instructional performance. Earlier 
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studies by Thonpson (1981) 9 Nat.lellc and Rove (1981) 9 and Natrlello and Cohn 
(1983) focused exclusively on teachers'" reports concerning the helpfulness of 
the supervisory procedures* 

Data collected froa all these studies Indicated * positive 
relationship between the two indicators of teacher internalization of the 
evaluation process (helpfulness In . *ovlng Instruction and Increased 
leverage over performance) and the two dimensions of the supervisory process 
(the frequency of evaluation and the amount of Influence teachers have over 
the process). 

Our study also examined the relationship between various dimensions 
of the supervisory process and Instructional Improvement* in our research, 
however, we analyzed additional elements of the evaluation process* In 
addition to examining the frequency of evaluations and the amount of 
Influence the teachers had over it, we also examined the following 
dimensions: the teachers' perceptions of the responeiveness of the 
evaluation process to Individual teaching circumstances, the clarity of the 
feedback the supervisory process provided, the extent to which the 
evaluations were based on objective data concerning Instructional 
performance, and the extent to which the evaluation process assisted teachers 
In improving their instruction. 

In contrast to Natrlello' s study, In which teachers' perceptions of 
Instructional improvement were assessed, we assessed the teachers' 
instructional behaviors directly, that Is, we measured how frequently the 
participating teachers applied the strategies recommended In the staff 
development program* Thus, our study provides a descriptive analysis of the 
Instructional supervision procedures and processes used In the participating 
secondary schools and Investigates whether there was a relationship between 
these characteristics and the Improvement of instruction, as measured by the 
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extent to which the teachers implemented the recommended Instructional 
strategies* 

Teacher Workload 

Another policy Issue Included In our study Involved the teachers' 
workload. Other than studies focusing on class size, there has been little 
research on the amount of work assigned to teachers. Research has not fully 
addressed the relationship between teachers' efforts to Improve Instruction 
and such factors as the number of classes taught, the number of different 
lesson preparations, the amount of time available during the school day to 
prepare lessons, and the amount of school-related responsibilities In 
addition to teaching (I.e., hall duties and extracurricular activities). 
Even though research on teaching has begun to Identify Instructional 
practices that appear to make an Important difference In student learning, It 
Is not yet clear whether those teachers who are assigned heavier workloads 
can apply these teaching strategies to the same extent or as effectively as 
taachers who have lighter workloads. 

Despite the paucity of research on the effects of teacher workloads 
on the quality of instruction, recent studies have suggested that a heavy 
workload Is one condition that severely limits teachers In the effectiveness 
of their instruction in secondary schools. For Instance, in his study for 
the Coalition of Essential Schools, Slzer (1984) recommends the following set 
of principles: 

- Teaching and learning should be personalized to the maximum 
feasible extent. Efforts should be directed toward a goal that no 
teacher have direct responsibility for more than eighty students. 

- Ultimate administrative and budget targets should Include, In 
addition to total student loads per teacher of 80 or fewer pupils, 
substantial time for collective planning by teachers, (pp. 
226-27) 
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In order to Investigate the iapact of teachers' workloads on 
Instructional performance, we examined the relationship between the extent to 
which participants In the staff development program Implemented the 
recommended Instructional strategies and their assigned workload. Chapter 3 
describes how this relationship was examined. 
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Chapter three 
Research Methodology 



R esearch Design 

The first research question posed In Chapter 1 was answered by using 
a pretralniog/posttralnlng, experlmental-group/control-group design* The 
question focused on the extent to which participants and nonpartlclpants In 
the staff development program Implemented the recommended research-based 
Instructional strategies. Schools were assigned to the treatment and control 
conditions In Kerch 1984. One class of each of the participating teachers In 
the control and treatment schools was observed for five consecutive days In 
May 1984, before the staff development program was presented. Two five-day 
observation periods were conducted In October 1984 and November 1984, after 
the program was administered. Classroom observers collected data on the 
Instructional strategies the teachers employed and on the number of students 
engaged in off- task behaviors. 

A static-group comparison (conditional) design, using only teachers 
In the treatment group, was employed to determine the answer to the second 
research question. This question asked whether there was a relationship 
between the extent of Implementation of the Instructional strategies and the 
amount of support the teachers received, their workloads, and the 
Instructional supervision and teacher evaluation procedures used at their 
schools. Surveys were administered in Feb mar, 1985 to tY . treatment-group 
teachers. The survey asked these teachers to assess the level of support 
they had received for improving instruction and to describe the level of 
their workload and their schools' Instructional supervision and evaluation 
procedures. 
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Recruitment of Sample 

Rgcrultment of Districts* Six school districts In the suburban 
Chicago, Illinois area were Invited to participate In the study. The 
districts were selected on the basis of the comparability of the communities 
they served and on the size of their schools. In addition, each district 
Involved In the study had Initiated efforts during the 1983-84 academic year 
to Improve their Instructional programs. These efforts consisted primarily 
of appointing a district task force to review existing curriculum and 
Instructional practices and to develop a set of recommendations for targeting 
their school Improvement plans. Thus, when these districts were Invited to 
participate In the study they considered their Involvement with the project 
to be complementary to the objectives of their Instructional Improvement 
plans; and, consequently, they responded enthusiastically to the Invitation 
to participate* 

Three districts were assigned to the treatment condition and the 
other three to che control condition. The training components of the project 
were administered to teachers In the treatment districts beginning In Kay 
1984; the control districts were offered the opportunity to participate In 
the program the following year. 

Recruitment of Schools and Teachers. The districts were Informed 
that the project would focus on applications of research-based Instructional 
principles within high school mathematics courses. Hence, the teacher 
training components of the project were provided exclusively to secondary 
school mathematics teachers. Since a major emphasis of the teacher training 
program was to foster colleglal teamwork, we decided that each school within 
the participating districts should be represented by at least three teachers. 
Thus, the selection of the participating schools was dependent upon the 
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nun be r of teachers willing to participate In the program. 

The teacher training component of the project required participants 
to attend a five-day seminar In the summer, in addition tc three follow-up 
sessions scheduled during the first semester of the following academic year* 
Since the staff development program required a time commitment beyond the 
teachers' contractual responsibilities 9 It was necessary to rely upon the 
teachers' voluntary participation in the program. However, participants were 
also given incentives to participate* /~rangements were made to award three 
hours of graduate credit from the University of Oregon to program 
participants. Participants had the option to receive up to $250 as a stipend 
in lieu of course credit, depending on the level of support each district 
provided to teachers who participated In district-sponsored summer workshops* 

In March 1984, program announcements were forwarded to mathematics 
teachers at each school within the participating districts* The 
announcements briefly described the program, the Incentives for 
participation, and the time commltmer*" required* The announcements also 
requested teachers to permit observations of one of their classes for five 
consecutive days In the spring of 1984 and for two five-day observation 
periods in the fall of 1984* In addition, the announcements sent to 
treatment-group teachers specified the dates for the program activities in 
1984, whereas the announcement sent to control-group teachers notified them 
that the program would be offered the following ye^r* Teachers were given a 
deadline of April 30, 1984 to decide if they .ere Interested in 
participating* 

Forty teachers from ten schools decided to participate. The original 
guidelines allowed a particular school to be involved In the program only If 
at least three teachers from the school volunteered to participate* However, 
after the initial responses had been received, there were a few teachers In 

23 

ERiC 27 



two treatment schools who decided to withdraw from the program or who 
requested to participate In the program after the registration deadline* In 
each of these Instances their change of plans Involved personal reasons 
(l*e*» change In summer vacation plans) rather than school-related ones, so 
those two schools were allowed to participate even though they were 
represented by less than three teachers* Eacf of the remaining eight schools 
were represented by at least three teachers* 

The total number of schools within the treatment districts was 7, and 
21 teachers from these schools participated* The control districts were 
represented by 19 teachers from 3 schools* Table 3-1 provides Information on 
the numbers of schools and teachers in the treatment and control groups* 



Table 3-1 

Treatment-Group and Control-Group Composition 



Treat?<mt Group 


Schools 


Teachers 


District 1 


4 


9 


District 2 


2 


9 


District 3 


_1 


__3 


Subtotal 


7 


21 


Control Group 






District 4 


1 


10 


District 5 


1 


4 


District 6 


_J_ 


_5 


Subtotal 


3 


19 


Total 


10 


40 



Description of Districts and Schools 

Each of the six participating districts were located In suburban 
Chicago, IlllnolSc The districts served middle-class communities and were 
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located within IS miles of each other* The number of high schools within 
each district ranged from two to four* 

All the participating high schools provided instruction for grades 
9-12, and the student enrollment at the participating schools ranged from 
1,500 to 2,100 students* Students were allowed to enroll in classes 
according to their completion of any specified prerequisites or, In the 
Instance of entry-level classes, on the basis of teachers' recommendations* 
The schools' mathematics instructional programs were similar in terms of the 
couroes offered (from general mathematics to calculus) and in term of the 
grade level at which students could take the courses* 

Description of Teachers 

The teaching experience of participating teachers ranged from 3 years 
to 23 years* Approximately half the teachers held master's degrees* 
Although the extent of the teachers' training and experience varied 
considerably, their past Involvement in district-sponsored staff development 
activities was quite similar* The staff development programs that the 
districts provided typically included full-day lnservlce workshops (i.e., 
Teachers' Institute Days) held at the beginning of the school year, and three 
or four two-hour lnservlce sessions scheduled periodically throughout the 
; The full-day workshops offered a range of topics: learning to 

administer CPR, identifying suicidal tendencies In adolescents, planning for 
retirement, and using teaching strategies from Hunter's (1976) "Instructional 
Theory Into Practice" model* Most of the two-hour lnservlce sessions were 
not related to the workshop topics* Instead, these sessions were usually 
devoted to individual department meetings at which curriculum-related Issues, 
such as the selection of new textbooks, were discussed* Occasionally, a 
formal program was planned for the two-hour lnservlce sessions* However, the 
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agenda for these programs often Included school-related Issues, such as 
policy revisions , or procedures concerning student grade c&rds, progress 
reports, or attendance lists* In a few Instances the program for the shorter 
Inservlce sessions Included presentations by community agencies* For 
example, the Chamber of Commerce had conducted a program on developing 
partnerships between schools and local businesses, and local health agencies 
had presented sessions that provided strategies to help prevent drug and 
alcohol abuse by adolescents* 

Staff Development Program Description 

The staff development program developed for this project was designed 
to help secondary school teachers minimise the time costs of mastery learning 
by maximizing the use of Instructional time* As noted earlier, both the 
selection of the program's content* and the design of program activities were 
research-based* Specifically, the content of the program was drawn from the 
research on classroom management and mastery learning, and the training 
activities Incorporated practices that staff development research had 
Identified as effective* 

The program Included three major sets of activities* -The activities 
were designed to provide teachers with direct support and assistance In their 
efforts to apply the research-based Instructional strategies In their 
classrooms. These activities Include a five-day summer seminar, three 
one-day follow-up sessions scheduled approximately one month apart during the 
first semester of the following academic year, and peer observations and 
coaching* These program components are described In the following sections* 
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Summer Seminar 

The first set of program activities was a five-day summer seminar 
that Introduced the teachers to classroom management aad organisational 
strategies and the principles of mastery learning* A research-based 
rationale fcr these Instructional strategies was presented, and evidence that 
links classroom management strategies with student academic engagement and 
that demonstrates the effects of corrective feedback on student achievement 
was highlighted* In addition, teachers received sample lessons that 
Incorporated these instructional design components* Although the sample 
lessons were offered as examples of how the research-based principles could 
be applied, we emphasized that there was no one "correct 11 way to apply the 
strategies and that the lessons were not Intended to be a formula or recipe 
for effective Instruction* 

The classroom management and organizational strategies in the staff 
development program were divided Into two categories: those that help to 
establish an effective classroom management rystem and those that help to 
sustain it* Briefly, the management strategies that can foster a productive 
learning environment Include establishing clear expectations and consequences 
for student academic and behavioral performance, eliminating or minimizing 
interruptions of Instructional time, and maintaining an academic focus* 
Those strategies that can serve to sustain an effective management system 
Include monitoring student behavior, planning for smooth transitions between 
Instructional activities, holding students accountable, and establishing a 
positive classroom climate* 

The presentation emphasized that perhaps the key underlying factor 
that accounts for the effectiveness of these classroom management strategies 
is that they are preventative measures as opposed to reactive steps taken in 
response to discipline problems* Thus, one of the aims of the staff 
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development program was to provide teachers vltb an opportunity to formulate 
some of their Instructional decisions from a proactive, rather than a 
reactive, stance. During the summer seminar the teachers were presented with 
a series of guiding questions regarding the management and organisation of 
their classrooms (e.g. , How will teachers communicate their expectations for 
student academic and behavioral performance? How can teachers eliminate or 
at least minimise Interruptions of instructional time?) These questions were 
posed to help seminar participants consider how they could most appropriately 
apply the research-based managerial strategies in their classrooms* 

The presentation on the instructional principles of mastery learning 
recommended that teachers Include formative testing and corrective procedures 
within the instructional design* Teachers were Informed that formative tests 
can provide students with feedback on their learning progress and can specify 
corrective procedures for them to follow for remediation of their learning 
errors* Teachers were discouraged from relying solely on summatlve tests, 
which simply rank students according to how well they have learned the 
content and objectives of the course* Instead, teachers were encouraged to 
administer formative tests, which provide students with feedback and require 
them to complete corrective learning activities if their test -performances 
are not adequate* 

To help teachers plan for Incorporating the principles of mastery 
learning within their instructional design, the following components of 
instructional planning were discussed: Identifying unit objectives, 
sequencing learning objectives, dividing learning objectives into meaningful 
units of instruction, and determining mastery standards* The design and use 
of formative tests for diagnostic purposes, the development of corrective 
procedureo to remedy identified learning problems, and enrichment 
opportunities for students who initially demonstrate a mastery level of 
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achievement were also discussed. Seminar participants vere reminded that 
Including corrective feedback within the Instructional design can prevent 
students from wasting time repeating their previous errors and can help 
teachers use Instructional time more effectively because corrective feedback 
helps them to Identify and remediate students' learning problems. 
Furthermore, the feedback-corrective function provides greater assurance that 
students understand the concepts or skills contained in one unit before they 
move to more difficult units* Thus the continuity of the learning process 
can proceed smoothly because students are prepared for each successive stage 
of learning. Another virtue of this technique is that It allows students In 
need of assistance to follow corrective procedures, while those students who 
have achieved a mastery level of performance have the opportunity to extend 
their understanding of the skills or concepts by completing additional 
learning activities that challenge them. 

Throughout the seminar, the Importance of the congruence of these 
instructional design components was stressed. It was emphasised that 
teachers should take care to ensure that learning objectives are clearly and 
precisely stated, that the lesson Is focused on mastery of these objectives, 
and that the tests administered to assess student performance ^relate directly 
to these specific objectives* 

Following the discussion on instructional design components, the 
seminar addressed the Implications of mastery learning on the students' role 
In the learning process* Teachers were Introduced to a basic principle of 
mastery learning: students are not allowed to move from one unit to the next 
until they have shown sufficient understanding of prior instructional units. 
In some cases, the fact that corrective procedures will be administered If 
the student does not achieve a mastery level of performance on the formative 
assessment of progress may require the student to develop attitudes different 
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from those he or she has had In previous courses. Thus, the training program 
stressed the need for teachers to inform students of the standards they are 
expected to achieve and of the responsibilities they need to assume for their 
own performance* 

In the seminar a discussion was also held on the implications of 
mastery learning on the pacing of instruction and the grading of student 
performance. The program director suggested ways that teachers could adjust 
the pace of Instruction appropriately by employing the principles of mastery 
learning. It was also suggested that the formative assessment tests be used 
only for diagnosing the students' level of understanding and for specifying 
corrective activities to remediate learning errors; thus, summatlve tests 
could bt used exclusively for grading purposes* Throughout the training 
program, time was allotted for clarifying and resolving any concerns the 
teachers had about these Issues* 

During the seminar, teachers we*" 'ivlded into content area teams* 
Each team developed lesson plans for Instructional units they planned to 
teach In the fall* By working together in teams, the teachers not only 
completed some advance planning but also had the opportunity to receive 
feedback on their plans from both the program director and their colleagues* 
Furthermore, the team planning sessions gave the teachers an opportunity to 
broaden their instructional repertoires by drawing from the strengths of the 
various teaching styles of the team members* At the conclusion of the 
seminar the teachers were requested to prepare an additional set of lesson 
plans that Incorporated the research-based instructional principles* 

Lastly, the teachers were asked to prepare for the first follow-up 
session a one* or two-page written overview of their use of the classroom 
management and mastery learning principles within the lesson designs for 
material they would be teaching during the first two weeks of the school 
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year* They were directed to Include both a description and an analysis of 
their experience In Introducing their students were Introduced to mastery 
learning instruction, the formative assessment process, alternative 
corrective and enrichment learning activities, and strategies they found to 
be effective for Implementing the classroom management principles. 



FolloiMJp Sessions and Peer Observations 

The purpose of the three one-day follow-up sessions, each scheduled 
approximately one month apart during the first semester following the summer 
seminar, was to provide teachers with ongoing assistance In their Initial 
classroom application of the research-based Instructional strategies* These 
sessions gave the teachers an opportunity to share with one another both 
their difficulties and their successes In using these Ideas* Like the team 
planning sessions, this exchange of Ideas helped Increase the number of 
options the teachers had for managing their classrooms and for applying the 
principles of mastery learning* 

During the first follow-up session, teachers exchanged additional 
lesson plans they had designed* Also, they were given the opportunity to 
share their concerns about the use of the research-based Instructional 
strategies. In these problem-solving sessions, the teachers discussed 
alternative ways to deal with these concerns, as well as considered ways to 
trouble 8 hoot other potential obstacles In Implementing the strategies* 

At the first follow-up session, the teachers were also given training 
In peer observation techniques* The trainer emphasized that the purpose of 
the observations was to provide objective, descriptive, nonjudgmental 
feedback to each other* It was noted that the peer observation process 
allowed teachers to act as mirrors for each other because they were 
collecting descriptive observational data that reflected the extent to which 
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their actual Instructional practice matched their Intended application of the 
research-baaed Instructional strategies* Moreover, by serving as observers, 
they could discover alternative approaches to applying these Instructional 
practices, which In turn could provide then with additional ideas for using 
these strategies effectively In their own class room. 

During the first eeaester after training, each teacher was Involved 
In a minimum of two observation cycles* Consequently, one of their 
colleagues observed the* twice, aid they observed one of their colleagues at 
least twice. The teachers were given the opportunity to choose which of 
their colleagues they wanted to observe their class. Substitute teachers 
were used to cover claasea for teachers scheduled to observe during their 
usual class tines. 

At the second follow-up session, the lesson plans the teachers had 
submitted at the first session were returned. Suggestions were based upon 
the feedback received at the first session and upon the program director's 
Individual recommendations. The teachers were then requested to prepare at 
least one additional set of lesson plans to be shared at the next session. 
In addition, at the second follow-up session the teachers discussed their 
experiences as peer observers and as coaches and shared teaching Ideas they 
had gained from observing each other* An additional observation cycle was 
then scheduled to follow this session. 

The teachers reconvened about one month later* In this final 
fullow-up session, teachers shared their concerns and suggestions, discussed 
effective instructional atrategiee they had observed in each other's 
classrooms, exchanged the lesson plana they had designed, and considered 
their future applications of the research-based principles In other courses. 

During each of the three follow-up sessions the teachera were offered 
additional research-based Information that could reinforce their application 
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of the strategies presented In the simmer seminar* Specifically* an overview 
of the research on problem-solving, student learning styles, and cooperative 
learning environments was given* This information was intended to help the 
teachers consider the multiple dimensions of their Instructional decisions 
and to enhance their appreciation of the Impact that those decisions have on 
their students" achievement* 

Overall, the staff development program provided the teachers with a 
summer seminar that gave them Intensive training in research-based 
Instructional strategies and with follow-up sessions that provided them with 
an extensive support system* The follow-up sessions also strengthened the 
teachers' efforts to Implement these strategies by allowing them to observe 
and coach one another* 
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Adminl s t ra t or s " Training Program 

In addition to the teacher training components of the staff 
development program, the program Included a two-hour seminar for the 
administrators of the participating schools* The seminar was held In May 
1984, prior to the teachers' training program* Although efforts were made to 
schedule the seminar on a date convenient for everyone, a few administrators 
were nevertheless unable to attend the May seminar* Thus, the seminar was 
offered again in September 1984 for those who did not attend the first 
session* 

Seminar participants Included all district-level and building 
administrators, as well as Instructional supervisors (l*e*. department 
chairpersons)* The seminar gave participating administrators an overview of 
the research-based Instructional principles Included In the teachers' 
training program, and a discussion of their Implications was held* Issues 
discussed Included the role of the student In the learning process, classroom 
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management concerns, the pacing of instruction, and the grading of student 
performance* 

The program director also suggested ways for administrators to 
support the teachers In their efforts to implement the recommended 
Instructional strategies* These support strategies, drawn from the research 
on effective schools. Included administrative support functions (Gersten and 
Carnlne 1981). the instructional leadership behaviors linked to the 
characteristics of effective schools (Russell and White 1980), administrative 
behaviors related to Instructional improvement (Bauchner and Loucks 1982), 
and the leadership functions that facilitate the Implementation and 
effectiveness of staff development programs (Gall et al* 1984)* 

Administrative strategies for strengthening the teachers' 
Instructional Improvement efforts Included: 

- advocating the commitment to help students achieve a 
mastery level of performance 

- helping teachers overcome obstacles to implementing 
mastery learning strategies 

- monitoring instructional performance and providing 
feedback 

- understanding that teachers' initial efforts to 
Implement the recommended instructional strategies nay 
be somewhat awkward at first 

- providing teachers with encouragement by recognizing 
their accomplishments 

- providing teachers with opportunities to share 
instructional ideas with each other by scheduling peer 
observations and colleglal planning sessions. 

The administrators were also encouraged to attend the summer seminar 

and follow-up sessions offered to participating teachers* Administrators 

were notified of the date and location of each session three weeks in 

advance* Although none of the administrators attended all of the sessions, 

at least one administrator represented each district durln^ each portion of 
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the teacher training program* The administrators who attended these sessions 
Included both building-level and district-level administrators. 

Observational Measures of Classroom Instruction 

The first research objective was to compare the Instructional 
behaviors of those teachers who participated In the staff development 
training program — the treatment group— to the teaching behaviors of those who 
had not been Involved In ^he program — the control group* A classroom 
observation instrument developed for this purpose was used throughout the 
observation process* Observation data were used to determine the extent to 
which participating teachers implemented the research-based Instructional 
behaviors presented in the staff development program and to assess the number 
of students engaged In off-task behaviors in the treatment and control 
classrooms. 

Teachers In both the treatment and control groups were observed on a 
p retraining/post training basis* During the spring of 1984, prior to the 
summer seminar* each teacher was observed for five consecutive days* The 
same class was observed each day* Observations were repeated twice during 
the first semester of the 1984-85 academic year* The first post training 
observation occurred in October, between the first and second follow-up 
sessions; and the second post training observation was conducted in November, 
two weeks after the second follow-up session* Observations were scheduled so 
that they occurred at the beginning of an instructional unit* 

The observation Instrument was designed so that It could also be used 
to assess the amount of Instructional time allocated to several Instructional 
functions beyond those recommended in the staff development program* This 
made It possible to determine not only whether the treatment-group teachers 
applied the recommended instructional strategies after training, but whether 
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they redistributed class time across various Instructional functions In order 
to accommodate the Implementation of the recommended teaching strategies. 
Consequently, the classroom observation Instrument was designed to assess the 
amount of class time the teacher allocated to the following Instructional 
functions: reviewing and correcting homework, presenting new concepts and 
skills, providing opportunities for students to practice new skills and 
concepts, conducting formative assessments of students' progress, helping 
students complete corrective and enrichment learning activities, directing 
students to complete practice exercises Independently, and administering 
quizzes, in addition, the Instrument was used to record the amount of class 
time spent in transition between Instructional activities and In nonacademic 
Interaction. Observers coded tne occurrence of these events at one-minute 
intervals throughout the Instructional period. At five-minute Intervals they 
recorded the number of students who were off-task. 

The observation Instrument, entitled "Instructional Functions Time 
Allocation Observation Instrument, 11 is presented in Appendix A. The 
Instructions give the classroom observer guidelines to follow while observing 
the teachers. The guidelines also provide an explanation of the coding 
procedures and definitions of the terms related to each instructional 
function. The cover sheet of the observation Instrument was used to record 
the name of the observer and teacher, the date of the observation, the name 
of the school, the title of the course, the number of students attending 
class, and the time class began and ended. The classroom observers were 
Informed verbally and In writing that the information being collected was for 
the sole purpose of educational research and that the names of Individual 
observers, teachers, and schools would not be Included In any subsequent 
reports concerning the classroom observations. The teachers and 
administrators of the participating schools also received assurances of 
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confidentiality* 

The instrument contains two pages of coding sheets to be completed 
during the observation* It has ttpace to record data throughout a one-hour 
instructional period* The first 17 rows of the instrument give the 
observation variables, and the columns represent each minute of instructional 
time* Observers use a stopwatch to determine each one-minute interval* At 
the end of each Interval the observer simply circles the code letter that 
represents the teacher's Instructional behavior* If more than one 
instructional behivior occurs during the one-minute interval, the obsen 
circles the code for each behavior* In such esses, fractional values are 
assigned to the specific behaviors* 

With one exception, the rows contain variables concerning teachers' 
Instructional behaviors. The exception Is the row that refers to the number 
of etudents off-task* At five-minute intervals, the obi -rvers record the 
number of students off-task during that ae-mlnute Interval* 

Training the Classroom 0 rvers 

The classroom observers were certified secondary school teachers who 
usually worked as substitute teachers* The participating school districts 
recommended specific Individuals to serve as observers* During the 
pretralnlng teacher observations four observers were employed* Another 
observer was added for the post training observations In October and November 
1984. because transportation difficulties limited one of the original 
observer's ability to travel between schools* 

A two-day observer training program was conducted during the first 
week of April 1984. prior to the pretralnlng teacher observations* The 
training program Introduced the observers to the observation Instrument and 
provided them with an explanation of the coding process* The observers the 

37 

41 



practiced observing secondary school mathematics classes in a 
nonpartlcipatlng school district that m located in a community similar to 
the communities served by the participating districts* Fortunately, some of 
the teachers being observed during this observer training period had 
participated the previous year in a staff development program on the 
Instructional principles of mastery learning* This gave the observers an 
opportunity to observe the strategies being used in the classroom and 
Improved their ability to distinguish among the various types of behaviors to 
b» recorded* 

After each of the three practice observations held on the first day 
of training, the observers met to discuss their experiences and to clarify 
any difficulties they had when coding the observed Instructional behaviors* 
On the following day, they observed two classes and then held a discussion. 
Since the observers did not raise any questions or concerns at this time, the 
principal Investigator decided to measure the extent of agreement among the 
observers* This measurement was to be based on the observers' coded 
responses from the next three observations* 

The reliability measurement for the observations was determined by 
calculating the extent to which the observers' coded responses agreed with 
those of the principal Investigator, who observed and coded the same closes 
as the trainees* Thus, a criterion-related agreement score was computed for 
each obseiver* The agreement scores ranged from 85 percent to 93 percent* 

The observer training program was repeated in September 1984, prior 
to the po8ttralning teacher observations* The training activities were 
identical to those described above* Following the second observer training 
period, exten^-of-agreement scores were again calculated, using the same 
method as before The agreement scores at this time ranged between 83 
percent and 91 percent* Table 3-2 summarises these agreement data. 
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Table 3-2 

Criterion-Related Agreement of Classrooa Observers 



Apr— 1984 (First training period) 


September 1984 (Second training period) 


Observer 1 93% 


Observer 1 


91% 


Observer 2 85% 


Observer 2 


85% 


Observer 3 90% 


Observer 3 


83% 


Observer 4 91% 


Observer 4 


82% 




Observer 5 


85% 



Throughout the entire study , the principal Investigator monitored the 
observation process by asking observers about their concerns related to the 
observations. The only problem was related to rescheduling observations If 
either the observer or teacher was 111* No concerns or questions directly 
related to coding Instructional behaviors were raised* 



Survey Measures 

Another objective of this study was to explore the relationships 
between program implementation and certain conditions that existed in the ) 
schools. These conditions included the support teachers received while 
implementing the research-based strategies, their workload, anc the teacher 
evaluation procedures at their schools. The following sections describe the 
survey instruments designed to assess these factors* 

Instructional Leadership Support Functions 

One of the survey instruments In this study asked teachers to 
describe the amount and sources of Instructional support they received in 
their efforts to Implement the research-bat d Instructional strategies 
contained in the staff development program* In a similar study of the role 
of administrators in the Improvement of practice, Bauchner and Loucks (1982) 
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asked teachers to report the amount of assistance they had received from 
their principals while Implementing new practices* However, the present 
study extended the data collection to Include the teachers' perceptions of 
the role that other Individuals within the school, In addition to the 
principal, played In supporting the Instructional Improvement process. Thus, 
the participating teachers were asked to describe the amount of suppc rt they 
had received and to Identify the source of the support* A survey Instrument 
designed for this purpose was used to collect their responses* 

The survey Instrument was adapted from the Ifeer Questionnaire 
designed by The Network for their project entitled "A Study of Dissemination 
Efforts Supporting School Improvement/ 1 A copy of the survey Instrument that 
was used appears as Appendix B* The first item in the survey asked teachers 
to evaluate the usefulness of the Instructional strategies presented in the 
program by comparing the advantages and disadvantages of employing the 
strategies* A 5-polnt response scale was used* 

The amount, sources, and usefulness of the support the teachers 
received were determined on the basis of their responses to survey Items 2 
and 4* The amount of support the teachers received was assessed within three 
categories ("not at all," "sonetlmes" and "frequently"). The^teachers were 
also asked to Identify the sources of the support they had received and to 
Indicate hew frequently the following individuals assisted them: principal, 
assistant principal, fellow teachers, department head, superintendent, 
assistant superintendent, and the training director* 

Lastly, the survey assessed types of support teachers received* 
These Included training In using the research-based strategies, opportunities 
to observe the instructional practices, moral support for trying to Implement 
new strategies, availability of materials, opportunities for problem-solving 
sessions, help In securing resources, Information on the goals and focus of 
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the Instructional strategies, Information about Implementing the strategies, 
und Information about the Impact of theii efforts to apply the strategies In 
their classes. 

The survey also contained three open-ended questions (Items 3, 5, and 
6). Item 3 asked teachers to Identify the one Individual vho had been most 
helpful to them In their Implementation efforts. Items 5 and 6 were Included 
to explore the teachers' perceptions concerning the Ideal amount and sources 
of support that could have been provided, as well as their perspectives on 
any school-related obstacles they encountered In their efforts to Implement 
strategies. 

The training director administered the instructional leadership 
support survey at the third and final follow-up session in February 1985. 
The survey was administered at the clone of the training period so that 
teachers would base their responses on their participation In the complete 
program and on their experiences after a full semester of applying the 
instructional strategies In their classes. The majority of the teachers 
completed the survey within a 15 -minute period. 

Instructional Supervision and Evaluation Procedures 

The relationship between the extent of the teachers' implementation 
of the recommended instructional strategies and the instructional supervision 
and evaluation procedures at their schools was also investigated. Therefore, 
data were collected that provided a set lescrlptlve features of the 
schools' instructional supervision and evaluation practices. 

Data sources Included the participating school districts' official 
statements regarding Instructional supervision and evaluation procedures, 
documents utilised in the supervisory process (i.e., observation 
instruments), and the teachers' descriptions of the school's instructional 
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supervision and evaluation practices* 

The teachers' descriptions were collected through a questionnaire 
(see Appendix C) that asked teachers to describe the school's evaluation 
procedures and to formulate Judgments concerning various aspects of the 
supervisory process. The descriptive Information collected from the survey 
responses Included the teachers' descriptions of their supervisors' 
responsibilities (i.e., department head, principal, assistant principal), the 
frequency of evaluations f the areas that were evaluated, and the procedures 
used (I.e., preobservatlon and/or postobservatlon conferences, prior notice 
of classroom observation, review of lesson plans, classroom observation). 

The teachers' responses to the items related to evaluation procedures 
provided an essentially objective account of the established conditions of 
their school's evaluation systems. In contrast, the remaining survey Items 
required the respondents to assess various characteristics of the supervisory 
process. The responses to these Items reflected the teachers' perspectives 
on the evaluation pro Among the questions contained in this section 

were the following; 

- How much Influence do teachers In your district have over the 
process of the evaluation of their Instructional performance? 

- To what extent does the evaluation process recognise the teaching 
responsibilities and concerns of each teacher? 

- How much assistance In improving the quality of Instruction Is 
provided to teachers through the evaluation process? 

- To what extent do the outcomes of the evaluation process rely on 
objective data, rather than subjective judgments? 

The teachers responsed by using a 5-point scale (1 - little or none; 

5 ■ significant amount). In addition, they rated the overall quality of the 

feedback they received from the instructional supervision process. Their 

responses to this Item were also given on a 5-polnt rating scale (1 ■ 

general, vague; 5 ■ specific, clear). 
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Lastly 9 the teachers were asked whether or not the instructional 
supervision process provided direction and support for individual teachers to 
inprove areas of weakness in their teaching performance, as well as to 
strengthen the quality of their performance. 

The survey was sent to each teacher prior to the third follow-up 
session of the staff development program* More than two-thirds of the 
teachers returned che surveys in the self-addressed envelopes that had been 
provided, while the others returned the surveys during the third follow-up 
session* 



Teacher Workload 

The third factor we investigated was related to the teachers' 
workload* The extent of the teachers' workload was determined by the 
teachers' responses to the Teacher Workload survey (Appendix D)« This survey 
requested information about the following factors: the number of classes 
taught each day, the amount of time allocated for each class, the number of 
different course preparations, the number of students per class, the grade 
levels of classes, the ability levels of their classes, the amount of time 
available during the school day for planning and course preparation, the 
amount of time assigned to nonius tructional responsibilities (i*e* , hall 
duties, cafeteria duty, bus duty), their duties related to extracurricular 
activities (i.e., coaching, club sponsorship), and the provision of released 
time or compensation for time spent beyond the required school-day hours to 
complete work on curriculum development and instructional improvement 
projects* 

In addition to asking for the teachers' objective account of these 
workload characteristics, the survey also asked them to rate the overall 
demands of their workload by describing it as "light." "manageable," or 
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"heavy." 

The Teacher Workload survey ni sent to the teachers prior to the 
third follow-up sessions, along with the survey on instructional supervision 
and teacher evaluation policies* Teachers completed and returned the Teacher 
Workload surveys in a pattern similar to the other surveys. Thus, the three 
surveys — instructional support, teacher evaluation, and workload— were 
completed and returned by all of the participants In the staff development 
program by the end of the third follow-up session. Chapter 4 reports the 
teachers' responses to these surveys, the data analysis procedures used, and 
other findings from the study. 
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Chapter Four 
Data Analysis 



This chapter presents the results of the data analysis. After the 
data collection process was completed, the collected data were used to 
determine the answers to the two research questions related to 1) the extent 
to which teachers implemented the research-based Instructional strategies 
presented In the training program and 2) the relationships between 
Implementation and selected school factors. The analysis of data related to 
these research questions Is reported below. 

Question #1: Did the teachers who participated In the staff development 
program apply the recommended teaching behaviors to £ greater extent than 
those who did not participate In the training program? 

An analysis of the extent to which the teachers Incorporated Into 
their lessons the research-based Instructional strategies presented In the 
staff development program Involved an assessment of data collected In 
observations of treatment-group teachers and control-group teachers. The 
observational data were used to determine the amount of class time that the 
teachers allocated to the following Instructional functions: reviewing and 
correcting homework, presenting new concepts and skills, providing 
opportunities for students to practice new skills and concepts, conducting 
formative assessments of students' progress, helping students complete 
corrective and enrichment learning activities, directing students to complete 
practice exercises Independently, and administering quizzes. In addition, 
data were collected to determine the amount of class time spent in transition 
between Instructional activities, class time spent in nonacademlc 
interaction, and the number of students engaged In off-task behaviors. 

To determine the answer to the first research question, an average 
distribution of time allocated to these Instructional functions was 
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calculated for each teacher over the five pretralnlng and ten post training 
observations , adjusted for differences In the number of minutes of classroom 
observation* These averaged percentages became the frequencies on which 
statistical analyses were based* Table 4-1 reports the average distribution 
per teacher In both the treatment and control groups* 

Table 4-1 

Average Percentage of Class Time Allocated to Six Instructional Functions 

Treatment Group Control Group 

Instructional Function Pre Post Pre Post 



Feedback-Corrective/ AX 21. 0% .71 .3% 

Enrichment Loop 



Transltlon/Nonacademic 


12.0 


8.5 


13.4 


11.3 


Interaction 










Review/Correcting Homework 


42.9 


28.1 


31.3 


35.8 


Quiz 


6.4 


7.8 


5.9 


10.3 


Development/Guided Practice 


27.9 


29.1 


27.0 


21.9 


Independent Practice 


10.7 


5.5 


21.7 


20.4 


Total 


100 X 


100 X 


100 X 


100 X 


(Sum of Frequencies) 


(2,100) 


(2,100) 


(1,900) 


(1,900) 
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The above percentages reveal that the chief Instructional behaviors 
of mastery learning, specifically In the feedback-corrective/enrichment loop, 
were extremely rare among both control-group and treatment-group teachers 
prior to training. Following the training program, however, the trained 
teachers allocated an average of about 21 percent of class time to this 
Instructional component* Since the training effect was so great, the 
calculation of a statistical test was needless* Furthermore, It should be 
noted that the percentages are an average, and this disguises the fact that a 
large majority of the teachers Implemented the instructional principles 
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presented In the training program* Of the 21 teachers who received the 
training, all but 3 allocated at least 10 percent of their class time to the 
feedback-corrective loop following the training program* Table 4-2 presents 
a frequency distribution of the percentage of time allocated to the 
feedback-corrective function by the 21 treatment-group teachers* 

Table 4-2 

Percentage of Instructional Time Allocated to Feedback and Correction 
Learning Activities In Posttralning Observations of Treatment-Group Teachers 

Percentage of Instructional Time Number of Teachers 



Since these findings Indicate that the teachers In the treatment 
group devoted a considerable amount of class time to the 

feedback-corrective/enrichment function after participating In the training 
program, whereas they had devoted virtually no time to It prior to training, 
It was of Interest to determine how they had distributed class time across 
the other Instructional functions to accommodate this change* The data In 
Table 4-1 shows that declines were greater In some of the functions than In 
others* Table 4-3 provides a more direct display* Percentages were 
recalculated from the frequencies for each of the Instructional functions, 
excluding the feedback-corrective/enrichment loop* A significant Chl-square 
computed for the 2 x 5 contingency table (64*788, 4 df) led to rejection of 
the hypothesis that the pretralnlng and posttralning distributions were 
alike* 



30-39 X 
20-29 X 
10-19 X 
0- 9 X 



4 
8 
6 
3 



21 
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Table 4-3 

Treatment-Group Teachers" Change In Percentage of Tine Allocated 
to Five Instructional Functions 



Instructional Function 


Pre 


Post 


Change 


Transit ion/Nonacadetoic Interaction 


12.0Z 


10. 11 


-1.3X 


Review/Correcting Homework 


43.0 


35.6 


-7.4 


Quiz 


6.4 


9.8 


3.4 


Development/Guided Practice 


27.9 


36.8 


8.9 


Independent Practice 


10.7 


7.1 


-3.6 


Total 


100 X 


100 X 




(Sum of Frequencies) 


(2,098) 


(1.659) 





The differences between the distributions of class time across the 
various Instructional functions indicate that following the training program 
the teachers allocated significantly more time to presenting and developing 
lessons and to administering quizzes, whereas they spent considerably less 
time reviewing and correcting homework and allowing students Independent 
practice. They also spent less time engaged In nonacademlc interactions and 
transitions between instructional events, although this difference was not as 
great as the others* 

Finally , the data collected in classroom observations provided the 
opportunity to compare rates of off-task behavior among students of the 
trained and untrained teachers* Table 4-4 shows the average incidence of 
off- task behavior in the 21 treatment and i9 control classrooms (corrected 
for differences In numbers of students) in the pretralnlng and posttralnlng 
observations* While the means of the two groups were quite similar in the 
pretralnlng observations, they differed substantially after the treatment 
group received training* The rate of off-task behaviors declined markedly in 
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the treatment classrooms, whereas it declined only slightly In the control 
class rooms • 



Table 4-4 

Mean Number of Students Engaged in Off-Task Behavior per Class 
In Treatment and Control Classrooms 





Pretralnlng 


Post training 


Adjusted 


Group 


Mean 


S.D. 


Mean 


S.D. 


Posttralnlng 


Treatment Classes (N-21) 


13.4 


6.53 


6.0 


3.91 


6.67 


Control Classes (N-19) 


16.8 


12.72 


14.2 


8.30 


13.42 


Since the incidence 


of off- 


-task behaviors was 


found to 


be rather 



strongly correlated in the 40 classrooms between pretreatment and 
posttreatment observations (r * .56), an analysis of covariance was performed 
on the data, using the pretralnlng observation incidence as the covarlate. 
The post means adjusted for the pre means are also shown in Table 4-4. The 
difference between the groups on the adjusted means was significant beyond 
the .001 level by the F test (F - 20.775, 2/37 df). 

Correlations between the pretralnlng and posttralnlng incidence of 
off-task behaviors for the two groups separately, however, showed a 
coefficient of .69 for the control classrooms and only .*4 for the treatment 
classrooms. A test for homogeneity of the regression lines slopes yielded an 
F ratio of 3.280, nearly significant at the .05 level (p < .078, 1/36 df). 
This raises the possibility that the training and/or alteration in the 
instructional design had more complex effects than merely enhancing the 
general level of student attention and interest. Examination of the 
scattergram for the treatment group indicated that the greatest declines in 
off-task behavior occurred in the classrooms of those teachers who initially 
experienced the highest incidence of student off-task behaviors. 
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To summarize, the findings of the study pertaining to the first 
research question clearly indicate that the teachers who participated in the 
staff development program made much greater use of the chief instructional 
strategies that had been presented, specifically, the feedback and corrective 
instructional functions. Furthermore, the results suggest that both the 
teachers and students utilised the available time for instruction more 
purposefully, since the amount of time spent in transition between 
instructional events and iu nonacademic interaction decreased by one-third, 
and the incidence of student off-task behaviors diminished by more than half. 

Question #2: Did a relationship exist between the extent to which the 
teachers who participated in the staff development program implemented the 
recommended instructional strategies and (a) the amount and sources of 
support the teachers reported that they received in their efforts to improve 
instruction (b) the instructional supervision and evaluation practices 
employed by their schools, and (c) the workload of the teachers? 

To determine the answers to the three parts of the second research 

questloi, we analyzed the survey responses of the 21 teachers who 

participated in the program* The surveys, described in Chapter 3, concerned 

the teachers' assigned workloads, their estimates of the amount and 

usefulness of support they were offered, and their perceptions of the teacher 

evaluation processes at their schools. The dependent variable in each of 

these analyses was the extent of implementation of the instructional 

strategies presented in the program. As discussed earlier, the proportion of 

instructional time the teachers allocated to feedback and corrective 

instructional strategies was considered to be the chief measure of 

implementation. Since the observational data indicated that the teachers 

allocated virtually no time to feedback and corrective strategies prior to 

the program, it was not necessary to adjust the post training scores by the 

pretralnlng scores. Hence, the mean percentage of instructional time the 21 
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treatment-group teachers allocated to feedback aud corrective strategies 
following their completion of the staff development program was uaed at the 
measure of program Implementation, 

I nstructional Support 

The teachers' responses to the instructional support survey were used 
tr de ~rmlne whether a relationship existed between the extent to *nlch the 
implemented the Instructional strategies prer?nted in the program 
and the amouut and usefulness of the support they receive**. As described in 
Chapter 3, the survey requested teachers to Identify the s* rces of various 
types of support, as well as to evaluate the usefulness of the support* The 
types of suppor listed in tb" survey included the following: training in 
using the research-based strategies, information on the goals and focus of 
the Instructional strategies, Information about Implementing the strategies, 
opportunities to observe the instructional practices, opportunities to ) 
collaborate and to engage In problem-solving sessions with colleagues, 
availability of instructional materials, Information about the Impact of 
efforts to apply the Instructional strategies, help It securing resources 
(released time, "eacher aides, equipment), and moral support for efforts to 
Implement the strategies* 

The teachers were also requested to Identify the sources of these 
types of support* The sources listed in the survey Included ttut training 
director, fellow teachers, the department he*U, the assistant principals, the 
principal, the assistant superintendent, and the superintendent* Finally, 
the teachers evaluated the usefulness of the support they were offered by 
completing a 3-point rating scale (1 ■ assistance was not useful, 2 - 
assistance was useful, 3 - assistance was very usefwl)* 

The t otal amount of support provided to % ach teacher was determined 
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by calculating a weighted frequency score. The score was derived by first 
multiplying the frequency by the usefulness rating the teachers assigned to 
each source of support and then summing these products. 

The data analysis Indicates that there was a positive relationship 
(r » ,39) between the total amount of support the teachers reported receiving 
and the extent to which they applied the Instructional strategies presented 
in the training program. 

Since this was the case, It was of Interest to examine t^e sources 
and usefulness of the support teachers received In their efforts to apply the 
recommended Instructional strategies. Table 4-5 provides a summary of the 
data collected pertaining to these factors. 

While *he teachers' ratings of the usefulness of each type of support 
varied only slightly, the differences In the number of sources fir each type 
of support Is of some Interest. It appears that the types of assistance 
dealing with the actual training — applications of the Instructional 
strategies, Information on program goals, and Instructional materials — were 
provided to the teachers by fewer sources, primarily by the trainer and the 
teachers" colleagues, than the types of assistance of a more general nature, 

such as moral support, help In securing resources, and opportunities for 

collaborative problem-solving sessions. Also, the teachers reported that 
they considered the clarity of the goals and focus of the program and the 
opportunity to collaborate with their colleagues to have been somewhat arore 
useful than the actual training Itself. In addition, It should be noted that 
the teachers reported that the moral support they had received came from more 
sources than thfc other types of support they received. Moreover, they rated 
the value of the moral support they received only slightly below that of the 
training program. 
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Table 4-5 

Teachers' Mean Usefulness Ratings of Nine Types of Support 



Type of Mean Sources 

Support Usefulness 3 Per Teacher 



Training In Using the Research- 2.44 2.05 
Based Strategies 

Information Concerning the Goals 2.60 2.24 
and Focus of the Instructional 
Strategies 

Information about Applying the Strategies 2.41 2.43 

Opportunities to Observe Demonstrations 2.34 2.24 
of the Instructional Practices 

Opportunities to Collaborate and to 2.56 3.38 
Engage In Problem-Solving Sessions 
with Colleagues 

Availability of Instructional Materials 2.43 2.33 

Information about the Impact of Efforts to 2.27 2.14 
Apply the Instructional Strategies 

Help In Securing Resources (Released Time, 2.35 3.90 
Teacher Aides, Equipment) 

Moral Support for Efforts to Implement 2.43 4.38 
the Instructional Strategies 

Usefulness values range from i (not useful) to 3 (very useful). 



Table 4-6 presents a further analysis of data related to the sources 
and usefulness of support teachers received. The data indicate that the 
majority of the teachers reported that the training director and their 
colleagues who participated In the program provided not only the greatest 
amount of support but also the most useful assistance across each of the 
specified types of support. The next levels of the amount and usefulness of 
support appears to have been provided by department heads, assistant 
principals, and principals, In descending order. The teachers reported only 
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Table 4-6 

Teachers' Mean Usefulness Ratings of Support from Seven Sources 



Sources of Mean Percentage of Mean Usefulness 

Support Teachers Receiving Support of Support 8 

Training Director C % 2.74 

Fellow Teachers 76 2.58 

Department Head 44 2.46 

Assistant Principal 40 2.12 

Principal 39 2.00 

Assistant Superintendent 15 2.12 

Superintendent 8 1.43 



Usefulness values range from 1 (not useful) to 3 (very useful). 

limited support from their superintendents. However, the teachers from one 
district reported receiving assistance from the assistant superintendent for 
curriculum and instruction, and they considered his support to have been 
useful. 

Lastly, the survey pertaining to instructional support, asked the 
teachers to assess the advantages and disadvantages of applying the 
instructional strategies. TaJs provided the opportunity to determine whether 
or not the teachers' attitudes about the merits of the Instructional 
strategies may have affected the extent to which they Implemented them. 
Table 4-7 provides a summary of these data. None of the 21 U ^chers believed 
the disadvantages outweighed the advantages, and only four felt they were 
about equal. The table of means suggests a rather close association between 
the teachers' views of advantageousness of the program and the extent of 
Implementation: A one-way analysis of variance applied to the means yielded 
an F of 3.121 (p - .069). 
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Table 4-7 

Hean Implementation Scores of Teachers by Their 
Eatings of Merits of the Applications of the Strategies 



Teachers" Perception of Number of Mean 

Merit of Strategies Teachers Implementation 3 s.D. 

Responding 

The advantages and the 4 10.50 s 8.10Z 
disadvantages were about equal 

The advantages somewhat outweighed * 21.25 12.79 
the disadvantages 

The advantages outweighed the 13 24.15 8.93 
disadvantages 

The disadvantages somewhat 0 
outweighed the advantages 

The disadvantages outweighed the 0 — — 

advantages 



21 21.00 9.56 

F - 3.121, 2/18 df , p - .069 

Mean percentage of Instructional time allocated to feedback and 

corrective Instructional strategies f 



Teacher Evaluation and Instructional Supervision Policies 

To determine whether or not the teacher evaluation and Instructional 
supervision policies and procedures of the participating schools and 
districts were related to teachers" Implementation o* the Instructional 
strategies, we analyzed two kinds of Information. First, we reviewed the 
districts' policy statements concerning teacher evaluation procedures to 
determine the similarities and differences among the policies. Second, the 
teachers" perceptions concerning the application of the evaluation procedures 
were analyzed. The review of the districts" teacher evaluation policies 
revealed several similarities, as well as a number of differences. Some of 
the similarities and differences are described below. 
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1* Statement of Philosophy and Purpose of Evaluation Procedures 
Although each district's statement of purpose for teacher evaluation 
was phrased somewhat differently, the Intent of each evaluation system was 
similar. Essentially the goal of each system was to provide a means for 
Improving instructional performance, in addition, each set of statements 
concerning the philosophy of the evaluation process stressed the Importance 
of engaging both supervisors and teachers in a cooperative effort that leads 
to the meaningful Improvement of instruction* Each district's complete 
statement of purpose is given in Figure 4 -A* 

Figure -A 

District 8' Statements of Purpose for Teacher Evaluation Procedures 
District ^ 

"It is our Intent that the purpose of any teacher evaluation is to 
increase the competence and growth of the teacher in order that the teacher 
improve classroom instruction for the students* Evaluation is a cooperative 
venture between two professional people and should be used as a diagnostic 
tool to indicate where Improvement is needed* Learning takes place and 
behavior is changed most rapidly and satisfactorily when people are engaged 
in activities designed to attain their own purposes — not purposes set up for 
them by others 

District 2 

"The essential purpose of evaluation is the Improvement of 
performance* Thus: 

the major focus is on improving rather than fault- 
f i tiding 

the Information produced is meaningful t~ the teacher 
for improvement of instruction 

the evaluators must take the necessary time to collect 
information that is adequate and to discuss it with the 
teacher* 11 
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District 3 

"Purpose of Evaluation: To evaluate the performance of the staff 
member In order to Improve job effectiveness* 

"Philosophy: A program of evaluation aids each teacher In a 
continuous self-appraisal of his/her performance and provides meaningful 
goals for self-Improvement* Simultaneously, It helps maintain, Improve, and 
enhance the quality of Instructional and supportive services* Such a program 
also stlm*' ates a cooperative effort to provide the best possible education 
which adheres to and complements the philosophy of the District*" 

2* Policy Formulation 

Each district provided, upon request, background Information on the 
formulation of Its teacher evaluation policies* In each case a committee of 
administrators and teachers was responsible for designing the evaluation 
system and for monitoring its effectiveness* One of the districts reported 
that it had also worked with a consultant from a local university during 
revision of its evaluation system* However, it should be noted that this 
revision was completed more than 10 years ago* 

Each district's evaluation policy statement mentioned that the policy 
reflected a contractual agreement between the teachers' association and the 
school board* Thus, any deviations from established evaluation procedures 
could become grounds for teachers to file a grievance* 



3* Criteria for Evaluation of Teaching Performance 
The statements about criteria each district used to evaluate the 
teacher j var, d with respect to the overall scope of the district's 
expectations* However, each district's policy Included criteria directly 
related to instructional responsibilities, as well as general Indicators of 
the professionalism of the Instructional staff* Each district's criteria for 
teacher evaluation are listed In Figure 4-B* Although each set of criteria 
refers to factors that deal with instructional performance, none of the 
policies outlines Indicators of successful fulfillment of the stated 
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expectations for performance. 

Figure 4 HI 

Criteria for Evaluating Teaching Performance 

District 1 



The following criteria are reconnected for use 
in evaluating the teacher's performance and 
analysis of that performance In the follow-up 
conference* 



!• Criteria for Teacher Evaluation — Classroom Performance 

A. Planning the Lesson 

1. Clearly defined objectives 

2. Appropriate choice of content and skills for th'4 age 
and ability groups 

3. Use of appropriate resource material 

4. Imaginative and creative use not only of required texts 
but also of supplementary material 

5. Attention given to appropriate teaching methods 

B. Conducting the Lesson 

!• Effective management of routine classroom procedures such as 
attendance taking, distributing, and collecting materials, etc. 

2. Clear communication of the objectives of the lesson to students 

3. Clarity of explanation and directions; evidence of subject 
matter competency 

4« Effective use of questions 
5. Variety of methods 

6* Balance of teacher and learner participation 

7. Positive climate because of teacher sensitivity to 
Interpersonal relations 

8. Meaningful assignments 

C. Follow-up Activities Designed to Evaluate Content and Skills Taught 

1. Appropriate testing procedures 

2. >sitive use of test results to assist student learning 
II. Criteria for Teacher Evaluation— Class room-Rela tec 

A. Personal Characteristics 

1. Initiative, vitality 

2. Poise , stability , confidence 

3. Self-awareness, striving for self-improvement 

4. Effective communication 

5. Responsibility 
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Ill* Additional Criteria for Teacher Evaluation 



The criteria In this category are Intended to 
be ot a positive nature and will be Included 
In the evaluation only with the mutual 
agreement of both parties. 



A. Interaction with Colleagues 
1* Cooperation 

2. Open-minded, flexible attitude 

3m Participation In professional activities and organizations 

4, Tolerance for opposing points of view In and out of the 
classroom 

5. Receptivity to evaluation, criticism, and suggestions 
6« Responsibility 

7« Participation In Inservlce 

8« Initiation of constructive Ideas and criticisms 

9* Effort to avoid criticism of other teachers or undermining 

of their Influence 
10. Effective contribution to the tasks and concerns of the 

department and the school as a whole through Individual, 

committee, or organizational work 

B« Interaction with Parents 

1* Effective parent conferences, when warranted, through adequate 

preparation, presentation, and summary activities 
2« Show of respect for mutual parent and teacher roles In 
the child - ** total development 

3. Effort to familiarize parents with their child's present 
progress and goals 

C. Interaction with the Community 

1* Awareness of community activities and organizations 
2. Effort to reflect a positive image In regard to one's 
school and profession within the community* 
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District 2 



Desired Teacher Performance Criteria 

lm The teacher Is committed — he recognises that his prlnary goal is to 
assist In the growth of students. 

a. Is readily available to students 

b. keeps abreast of trends In Instruction 

c # recognises that his regular attendance Is necessary 

d. adapts methods and Material to Individual needs 

e« strives continually to improve Instructional techniques 
f • practices hygiene and has mannerisms which do not interfere 
with the performance of his responsibilities 

g. supervises student when and where necessary and appropriate 

h. r dcs and accepts guidance from peers and specialised and 
supervisory personnel 

2. The teacher likes people and has a positive, enthusiastic approach 
to th* children he teaches* 

a* generates mutual respect through a relaxed class atmosphere 
b. has generally positive parental responses 
c« approaches his work enthusiastically 
dm possesses a sense of humor 

e« encourages active participation and recognizes the Instructional 
value of his own silence 

3. The teacher Is sensitive to the Individual needs of children and tries ) 
to have empathy with them* The teacher reepects the Integrity of 

- children even when their goals differ from his. 

a. uses pretesting In determining needs 

b. analyses tests with students 

Cm accepts varying levels of achievement 

d« accepts student disagreement 

e. makes objectives and evaluation techniques understood 
f • stresses positive reinforcement 

g* respects the confidentiality of student records 

4. The teacher keeps the course objectives in sight; he is persistent in 
working toward these goals while retaining perspective of the total 
educational program* 

a* has written objectives 

b. can relate Individual lessons to objectives 

Cm develops and follows Instructional plans 

d. Is flexible to needs and Interests of students 

e« facilitates Instructional student activities 

f • exhibits broad educational perspectives 

5. The teacher helps students synthesize individual learnings with the 
total learning experience in and out of school. 

a* uses Illustrations from contemporary life 
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b* relates current lessons to previous learning 

Cm refers and relates his lessons to other disciplines 

d* Involves students In planning objectives and activities 

6* The teacher has a strong sense of direction but recognizes the value 
of propriety* 

a. proposes and Initiates courses of action Intended to benefit 
students, faculty, or school community 

b. compromises with staff and students 

c. has an objective approach to problem solving 

d* assumes responsibility In team or committee work 

7* The teacher recognises the value of positive school-comnunlty relations* 
a* responds promptly to parental concerns 

b. inform parents of exceptional accomplishments and deficiencies 
promptly 

c* uses discretion In discussing school affairs 
d* Implements the adopted curriculum reflecting the needs and 
aspirations of the community 



District 3 

The following criteria should be used as a basis for evaluation: 
The competent educator: 

1* Uses a variety of methods and techniques to reach goals 

of the educational program* 
2* Selects and organises materials that meet the objectives 

of the educational program* 
3* Evaluates student achievements, revising instructional 

activities when necessary to meet student needs* 
4. Helps students relate school work to their own experience* 
5* Creates end maintains an atmosphere conducive to student 

achievement* 

6* Cooperates with colleagues in planning and Implementing the 

educational program* 
7* Demonstrates tolerance and respect for the ability and worth 

of every student* 
8* Follows a plan, formal or informal, for professional growth* 
9* Communicates with parents and students in order to promote 

student progress* 
10* Is ethical In dealing with students, colleagues, and members 

of the community* 

11* Complies with policies, regulations, and directives of the school 
district* 
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4. Procedures for the Evaluation of Instructional Performance 
The procedures the districts used to evaluate teachers were 
remarkably similar. Each district relied primarily on Information collected 
In classroom observations, the focus of the evaluation process. In each 
district the supervisor and teacher met prior to the observation to discuss 
the teacher's Instructional goals In the class to be observed. A 
pcstobservatlon conference was then held to discuss whether or not the goals 
were attained, to determine both the strengths and weaknesses of the 
teacher's performance, and to *aake recommendations for improving Instruction. 
Also, during the postobservatlon conference the formal statement of 
evaluation was prepared; and a copy of the statement, signed by both the 
supervisor and teacher, was then placed In the teacher's personnel file. 

Although the districts' sets of procedures outlined the irajor events 
of the evaluation process (I.e., pre- and postobservatlon conferences), none 
of the procedures provided any Indication of the elements of effective goal 
setting, the nature of the data collection process to be conducted during the 
classroom observation, or the analysis of observation data discussed at the 
postobservatlon conference. 

5. Supervisory Responsibilities for Evaluation 
The department chairpersons In each district were assigned the 
primary responsibility for evaluating teachers. In Districts 1 and 2, 
building administrators (either the principal or assistant principal) were 
also responsible for teacher evaluation. However, In District 3, building 
administrators were not Involved In any phase of the evaluation process. 
Moreover, In Districts 2 and 3, teachers completed self -evaluations. In 
District 2, all nontenured staff completed self-evaluations three times each 
year; however, tenured staff were not required to evaluate theuaelves. In 
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contrast, District 3 required all teachers to complete self-evaluations once 
a year, but evaluation statenents were not Included in the teachers" 
personnel files. District 2 provided teachers with the additional option of 
having peer evaluation* It should be noted, however, t!.at peer evaluations 
did not replace evaluations by department chairpersons or building 
administrators. 

6. Frequency of Evaluations 

A comparison of the frequency of the evaluations conducted In each 
district shows that District 2 had the most Intense evaluation system. All 
nontenured teachers were evaluated at least three times each year by their 
department chairperson and at least three times by a building administrator. 
Tenured teachers were evaluated every three years. During a tenured 
teacher's evaluation year, the department chairperson evaluated the teacher's 
performance three times, In addition to at least three evaluations completed I 
by a building administrator. Figure 4-C displays the assigned supervisory 
responsibilities for and the frequency of evaluations within each district. 
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Figure 4-C 

Teacher Evaluation Procedures: Supervisory Responsibility 
and Frequency of Evaluation 



Supervisor Responsible 



Frequency of 
Evaluation 



No n tenured 

District 1 Department Chairperson 2 tlmes/yr 

1 tlme/yr 



District 2 



Department Chairperson 

Building Administrator 
(Principal or 
Al distant Principal) 

Department Chairperson 



at least 
3 times/yr 

at least 
3 tlmes/yr 

optional 

3 tlmes/yr 

District 3 Department Chairperson 1st yr teacher: 

2 tlmes/yr 

2nd yr teacher: 
1 tlme/yr 

1 tlme/yr* 1 tlme/yr 

^required, but not Included 
in personnel files 



Building Administrator 

Peer Teacher 
Self-Evaluation 
Department Chairperson 



Tenured 
1 tlme/yr 
1 time/3 yrs 

3 time 8/ 3 yrs 

3 times/3 yrs 

optional 
optional 
1 time/3 yrs 



Se If -Evaluation 



It is of some interest to note that the participating teachers from 
District 2, which had the most frequent evaluations, Implemented the 
strategies least frequently. However, there were only three participating 
teachers in District 2. Table 4-8 summarizes the mean implementation scores 
for teachers In each district. 
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Table 4-8 

Mean Implementation Scores of Teachers by District 



Number of Mean s.D« 

Teachers Implement at lcn a 



District 1 9 25.561 6.11 

District 2 3 6.33 7.09 

District 3 9 21.22 11.09 

*Mean percentage of Instructional time allocated to feedback and 
corrective Instructional strategies 



Teachers" Perspectives on Teacher Evaluation Procedures 

We used the participating taachers" responses to the survey 
~ aicerning the teacher evaluation procedures at their schools to assess their 
perspectives on these procedures across a number of dimensions of the 
evaluation process* These dimensions included the amount of Influence 
teachers felt t^ey had over the evaluation process 9 the extent to which the 
evaluation process recognizee the differences in responsibilities of 
Individual teaching assignments 9 the extent to which the outcomes of the 
evaluation process relied on objective data rather than on subjective 
judgmeats, the clarity and specificity of the feedback provided In the 
evaluation process 9 and the extent to which the evaluation process focused on 
Improving areas of weakness and strengthening the quality of teachers" 
Instructional performance. 

The teachers isslgned a rating to each dimension noted above. Their 
ratings were then categorised as being either Ijv or high, according to the 
level of rating they had assigned to each factor. A "conditions of teacher 
evaluation practice 91 score was then calculated for each teacher by obtaining 
the sun of the scores assigned to each dimension* The highest sum of these 



scores was considered to be indicative of the best of "conditions/ 1 In other 
words, those teachers who assigned high .r ratings to each of these dimensions 
of the evaluation procedures were viewed as those who held more favorable 
perspectives on the evaluation process as compared to those who assigned 
lower ratings. A Pearson correlation coefficient was used to test whether 
there was a relationship between the teachers' "conditions of evaluation 
practice*' scores and their implementation scores (the mean percentage of 
Instructional time they allocated to feedback and corrective Instructional 
strategies). 



-0.34, p - .13) between the teachers' perspectives concerning the 
f avorability of the conditions of the teacher evaluation process and the 
extent to which they Implemented the instructional strategies presented In 
the training program. Thus, the findings suggest that those teachers who 
helJ the more critical perspectives on the evaluation process were those who 
Implemented the strategies to the greatest extent. 



perspectives on the dimensions of the evaluation process, the survey data 
also provided the teachers' ratings of the overall level of assistance the 
evaluation process provided in Improving instruction. Pearson correlation 
coefficients were calculated in order to investigate the relationship between 
the ratings teachers assigned to this survey it^m and 1) their "conditions of 
evaluation practice" scores and 2) their implementation scores. A strong 
positive relationship was found between the teachers' ratings of the extent 
of the assistance the evaluation process provided to Improve instruction and 
their perspectives ou various conditions of the process (r - .65, p - .001). 
However, a negative relationship was found when the teacher Implementation 
score was considered a~ .he criterion variable (r - -.41, p ■ .06). 



These data Indicate that there was a negative relationship (r - 



In addition to providing a method for assessing the teachers' 
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Teachers' Workload 

The third variable we considered In relation to the extent of 
strategy Implementation wai the teachers' workload. Several dimensions of 
the teachers' workloads were assessed by analyzing responses to the Teacher 
Workload survey (see Appendix D), 

Among the factors related to the teachers' workloads that ware 
relatively constant across the sample were the number of classes the teachers 
were assigned, the amount of time engaged In Instruction, the amount of time 
teachers were responsible for supervisory assignments such as monitoring 
study halls or cafeteria duty f and the amount of time allotted for 
conferences and planning activities. 

The conditions of the teachers' workloads that varied considerably 
across the sample were the number of course preparations f the range of 
students' ability levels, and the number of students assigned to their 
classes* The number of course preparations the teachers reported ranged from 
two to four* Similarly, the number of student ability levels within the 
teachers' classes ranged from one ability level per class to three different 
ability levels. Finally, while some teachers Instructed as few as 90 
students, others taught as many as 149 stuuents. 

In the analysis of the teachers' workloads, we considered the 
conditions discussed above (the number of course preparations, the range of 
student ability levels, and the number of students assigned to their classes) 
to be contributing factors to the Instructional demands the teachers faced 
each day. Each of the conditions classified an r low, M "medium," or "high," 
depending upon the magnitude of each factor. Each teacher's 'Instructional 
demands" score was then derived by adding the scores t*~e teacher assigned to 
each condition. In other words, the "Instructional demands" of those 




teachers wbo vere responsible for only two different course preparations for 
students of the same ability level and who Instructed the least number of 
students were considered to be 1 w, as compared to the Instructional demands 
of teachers who taught a greater number of different courses with more 
students of varying ability levels. 

We also collected data on the number of hours per week the teachers 
were responsible for directing extracurricular activities* The number of 
hours that the teachers engaged In these activities ranged from none to 25* 
A numerical "low," "medium," or "heavy" rating was assigned on the basis of 
the number of hours the teachers were responsible for extracurricular 
activities. This factor was then added to the teachers' Instructional 
demands score to derive an overall workload score* Following the 
determination of each teacher's workload score, we calculated a Pearson 
correlation coefficient to test the relationship between the teachers' 
workload scores and their Implementation scores* The analyses revealed a 
statistically insignificant relationship (r - -*11) between the teachers' 
workloads and the extent to which they applied the strategies. 

An additional item of the Teacher Workloau survey asked teachers to 
Indicate whether their districts compensated them for time spent outside of 
their teaching or extracurricular responsibilities to vorl: together on 
Instructional Improvement projects* Although more than two-thirds of the 
teachers reported that they were provided with compensated time to engage in 
such activities, the data analysis indicated that compensated teachers did 
not Implement the Instructional strategies to any greater extent than did the 
uncompensated teachers* These data are presented In Table 4-9* 
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Table 4-9 

Mean Implementation Scores of Teachers Compensated and Not Compensated 
for Instructional Improvement Projects 



No* of Mean S.D. 

Teachers Implementation* 



Compensation Provided 15 22.5X # 10.77% 

No Compensation Provided 6 17.3 9.79 

Mean percentage of Instructional time allocated to feedback 
and corrective Instructional strategies 



The final survey Item asked teachers to rate the overall demands of 

their workload as light , manageable, or heavy. None of the teachers reported 

that they had been assigned "light" workloads. The analysis of the data 

revealed that those teachers who considered their workload to be the heaviest 

had the highest implementation scores for the Instructional strategies. A 

sue nary of these data is presented In Table 4-10. 

Table 4-10 
Mean Implementation Scores by Teachers' 
Perception of Overall Workload 



Teachers' Perception of No. of Mean S.D. 

Overall Workload Teachers Implementation 0 



"Manageable" 16 19.5% 10.07% 

"Heavy" 5 29.0 8.31 

"Light" 0 

t - 2.108 
p - 049 

a mean percentage of Ins tlonal time allocated to feedback 
and corrective instructional strategies 
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Summary 

In summary, the results Indicate that a different answer was obtained 
for each component of the second research question. The question focused on 
the determination of a relationship between the extent to which the teachers 
Implemented the Instructional strategies presented in the staff development 
program and three conditions within their schools. The first condltl n was 
the amount of support the teachers were provided to apply the instructional 
strategies. A positive relationship (r - .39) was found between the amount 
of support they reported receiving and the extent to which they implemented 
the strategies. In contrast, there was a negative relationship (r - -.34) 
between the teachers' perceptions of the instructional evaluation procedures 
employed by their schools and their Implementation of the strategies. 
Finally, no relationship was detected between the workload assigned to the 
teachers and the extent of their Implementation. 
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Chapter Five 
Discussion 



This chapter Is organized Into three sections. The first two 
sections discuss the findings related to the study's two major research 
questions. The first of these two sections analyzes the effectiveness and 
the significance of the staff development model developed and tested In the 
project. The second section Investigates the meaning of the findings 
pertaining to the Instructional leadership support functions and policy 
issues related to teacher evaluation and workload. The Implications of these 
findings for the design and delivery of staff development programs and the 
organizational conditions that support Instructional Improvement In secondary 
schools are also discussed In the first two sections. The third section 
outlines recommendations for further research on the process of Improving 
Instruction In secondary schools. 



Staff Development Program Effectiveness 

One of the primary objectives of this study was to determine the 
effectiveness of the staff development m,del developed for this pro1~~t. The 
model's design, described in Chapter 3, Incorporated findings from r «earch 
on instructional design and on staff development. Training In the 
application of research-based instructional strategies related to the 
principles of mastery learning and classroom management comprised the content 
of the program, and the program's training activities were drawn frca 
research on effective staff development practices. The effectiveness of the 
program was determined by comparing the Instructional behaviors of those 
teachers who participated In the program and received training with the 
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teaching perform ace of teachers who did not receive the training* 

The results pertaining to the extent to which the trained teachers 
Implemented the Instructional strategies yielded two sets of implications 
that have significance for the design of subsequent staff development 
programs. The first set of implications relates to the program's content , 
specifically, to the notion of combining research-based classroom management 
strategies and the principles of mastery learning in the staff development 
program* The second set of implications pertains to the contribution of the 
research on effective staff development practices to the design of 
professional development programs for secondary school teachers* 



Program C ontent 

Although the research on teacher effectiveness has consistently 
underscored the Importance of the instructional principles of mastery 
learning, particularly the use of the feedback-corrective/enrichment loop, it 
has not identified the most practical ways to provide sufficient time for 
teachers to engage in corrective and enrichment activities, in addition to 
their other instructional activities, within a fixed amount ^>f class time* 
Moreover, some researchers have suggested that allocating Instructional time 
for corrective learning activities may present the classroom teacher with an 
ethical dilemma. For Instance, Cohen (1984) warns that the price some 
teachers pay when they set aside class time for remedial learning activities 
within a group-based Instructional format Is th** they place limits on the 
more talented students' learning opportunities* Similarly, Slavln and 
Katwelt (1984) speculate that the benefits of corrective instruction may be 
diminished because it takes time away from instruction to the whole class* 

One of the few studies of group-based mastery learning that has 
directly Investigated the Issue of time allocation for the 
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feedback-corrective/enrichment loop is Arlin's (1982)* He examined the 



Implementation of mastery learning principles by 28 elementary teachers who 

volunteered for a pilot project In their classrooms* 

Two major findings resulted froa Arlln' s study* The first finding 

concerned where the teachers obtained extra time to provide corrective 

learning activities for their "slower" learners. Arlln reported that 

teachers used an ultimately unsatisfactory method: 

The solution most teachers adopted was to make the lessons 
shorter than originally planned so that they could have 
considerable time left In the class period to Include at 
least one remedial session and re test. Usually students who 
needed additional remedial sessions were seen by the teacher 
during recess or lunch, a practice that was not likely to be 
received favorably over a long period of time* 

The second finding concerned allocation of Instructional time for 

"faster" strd^nts* Again. Arlln reported another unsatisfactory solution: 

Many teachers originally planned enrichment work for the 
faster students, such as more advanced work on the topic 
under consideration. • • • [They] eventually gave up 
assigning enrichment activities and allowed activities such 
as free reading, work In other subjects, trips to the 
library, or quiet socializing at the back of the room* 
Cooperation of ft iter students took precedence over further 
depth, and particularly over further breadth. The major 
concern with faster students did not seem to be with 
enrichment but with the managerial requirement to keep them 
occupied. 

Our study provided a test of the notion that teachers could minimise 
the time costs of mastery learning by maximizing their use of instructional 
time through the application of research-based classroom management and 
organizational strategies. Moreover, the design of the study enabled us to 
examine directly the participating teachers' use of instructional time and 
the learning conditions they provided for both their "slow" and ,k f ast H 
1 earners. 

As noted In Chapter 4, the results of our study clearly Indicate that 
the participating teachers made much greater use of the 
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feedback-corrective/enrichment loop in their lessons than did the 
nonparticlpatlng teachers. Furthermore, the findings suggest that both tte 
teachers and students utilized the available time for instruction more 
purposefully , since the amount of time spent in transitions between 
instructional events and in nonacademlc interaction decreased by one-third, 
and the rate of student off-task behaviors diminished by more than one-half 
from thef.r pret raining levels. 

The findings that pertain to the teachers' allocation of time for 
various instructional functions are of particular interest. For e. aple, the 
time allocated to independent seatvork decreased by almost one-half , 
suggesting that the teachers spent more of their time during the 
Instructional period engaging their students in substantive academic 
interaction rather than simply monitoring student work* Also, the 
instructional time teachers spent reviewing and correcting homework decreased 
by one-third. These results suggest that racher than spendir % class time 
reviewing previous lessons and correcting homework exercises, the teachers 
were focusing on the specific concepts or skills that the students' 
performance on formative assessments had identified as needing improvement. 
Consequently, these teachers may have been able to tailor their lessons more 
appropriately to their students' learning needs. 

In addition, the results Indicate that teachers spent significantly 
more time presenting and developing new material and administering quizzes 
after they h<< participated in the training program. Thus, both of these 
functions appear to have taken on greater priority, in terms of allocated 
time. 

The observation data also revealed that the greatest declines In 
off-task behaviors In the treatment classrooms occurred In the classrooms of 
those teachers who initially experienced the highest Incidence of student 
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off-task behavior. One possible explanation for thle outcome la that the 
teachers who Initially had to contend with higher rates of student off-task 
behaviors may have considered tnelr student*' behavior to be a serious 
barrier to their Instructional effectiveness and, consequently, may have 
applied the classroom management strategies presented In the training program 
In a more systematic fashion* 

Another reason for this difference In the rate of decline In off-task 
behaviors may be related to the effect of the learning-f or-mastery proceed on 
student learning skills. The findings in a study by Hecht (1977) Indicated 
that students acquire and/or further develop learning- to-learn skills In 
mastery learning Instructional programs. Those students who demonstrate the 
highest rates of off-task behaviors possibly can be characterized as those 
who approach their studies without a clear sense of purpose* Perhaps i ) 
these students become more proficient at applying learning skills and begin 
to take on greater responsibility for their academic performance under the 
mastery learning approach to Instruction, they may also begin to view their 
of f-task behaviors as an obstacle to their academic success and, 
consequently, place a greater value on the ways they spend Instructional 
time. 

Lastly, It is Important to note that the teachers reported at the 
last follow-up session that they had covered the same amount of material In 
their classes during the first semester after the program as they had In one 
semester during prior years. Hence, It appears that they did not alter the 
scope or the pace of Instruction as they Implemented the learning-f or-mastery 
techniques. In other words, they did not sacrifice content coverage In their 
effort to Increase their students' content mastery. 

The findings In our study differ In several respects from those 
reported by Arlln (1982), For example, he found that teachers In his study 
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shortened presentation and development of their lessons so that they could 
provide feedback to students on their learning progress and Involve them In 
corrective leaning activities. Howevei, In our study the teachers allocated 
significantly more time to the initial presentation of each lesson* 

Second. Arlln reported that the teachers in his study met with the 
students who needed additional remedial assistance oaring recess and lunch 
time. He noted that the teachers considered this to be an excessive burden 
on their time and speculated that they would discontinue this practice 
shortly after the pilot project was completed. In contrast, the findings in 
our study Indicate that teachers provided a significant amount of time within 
allocated class time for the feedback-corrective loop. 

Lastly, in Arlln's study the teachers 4 " primary concern regarding 
their "faster" learners was simply to keep them buny rather than to provide 
them with instructional activities that enriched their learning. 
Furthermore, he reported that the teachers diminished the availability of 
learning opportunities for the faster learners, while they Increased the 
amount of instruction for the slower students. Contrary to Arlin's findings, 
the results of our study indicate that neither the pace of Instruction nor 
the amount of time allocated to the presentation and development of each 
lesson was adversely affected by the teachers' application of mastery 
learning principles. Since there was no difference In the amount of material 
covered before and after the training, It would appear that the teachers did 
not alter the scope of Instruction to accommodate the learnlng-for-mastery 
process. Furthermore, in soap cases the teachers provided their students 
with opportunities to pursue the learning objectives at a greater depth of 
understanding following the training program than they did prior to training. 
Pance, It seems that the approach to instruction they employed wae not 
consistent with the "Robin Hood" philosophy teachers In Arlln's study used, 
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since neither the breadth nor the depth of Instruction was diminished after 
the teachers began to apply mastery learning procedures. 

The differences In the findings of our study and those of Arlln's 
possibly can be attributed to the fact that our staff development program 
provided the participants with training In the application of research-based 
classroom management and organizational strategies In addition to the 
Instructional principles of mastery learning. Findings from the research on 
Instruction have consistently Indicated that without an effective classroom 
management system that holds students accountable for a clear set of academic 
and behavioral expectations and that establishes an environment conducive to 
learning, even the most thoughtfully and carefully designed lessons will fall 
to be as successful as they would have been otherwise (Evertson and Emmer 
1982). Furthermore, these findings indicate that teachers' managerial 
decisions can have a direct Impact on the proportion of time that Is devoted 
to teaching and learning (Anderson, Evertson, and Brophy 1978; Berliner, 
Fisher, Fllby, and Harllave 1978; Emmer and Evertson 1980, 1981; Fltzpatrlck 
1982; Good and Grottws 1977; Stalllngs 1980). 

Our results suggest that instructional time within a group-based 
Instructional setting can be positively altered to accommodate Implementation 
of the principles of mastery learning without sacrificing the amount of 
content presented and without placing one group of studeats at a disadvantage 
while Increasing the benefits of instruction '.or others. The findings seem 
to Indicate that the staff development program used In this study, which 
trained teachers \n the application of classroom management a**d 
organisational strategies along with the instructional principles of mastery 
lea ruing, gave them an advantage in their use of instructional time. They 
Incorporated feedback and corrective strategies within t e instructional 
design to enhance their students' understanding of their lessons, and both 
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students and teachers used Instructional tine In a more purposeful and 
productive manner* In short, It appears that the teachers' efforts to 
Increase their students' mastery of their learning were bolstered by their 
application of both the principles of mastery learning and research-based 
classroom management strategies* 

To summarize, the combination of the research findings on classroom 
management and on the principles of mastery learning appears to offer 
teachers a set of effective and efficient strategies that can enable them to 
assist all their students In achieving higher level of mastery of their 
learning within the scheduling and time constraints of most secondary school 
classrooms* 



Training Process 

The second set of implications related to the effectiveness of our 
staff development model pertain to the training processes employed* One key 
factor that possibly can be attributed to the extent of the implementation of 
the program's Instructional strategies is the design of the staff development 
activities provided* The program's training activities were modeled after 
those that staff development research has found to be effective, and their 
design Incorporated tho»e research-based staff development practices that 
of fpred the greatest likelihood that the teachers would Implement the desired 
: instructional strategies* 

In addition to the program's teacher- training components, a seminar 
was held for the administrators of the schools participating In the program 
(see Chapter 3)* The purpose of the seminar was to provide the 
administrators with an overview of the research-based Instructional practices 
presented In the teacher-training program, as well as to suggest ways they 
could support the teachers In implementing the recommended Instructional 
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strategies These support strategies were dtawn from the research on 
effective schools. 

The training program was deliberately designed to provide the 
teachers with both direct and Indirect sources of support. Direct support 
was offered through the program activities. In addition, the program 
Indirectly supported their efforts to improve Instruction by helping to 
establish between the administrators and the teachers a common language 
concerning effective instructional practices, and by nighl /.itlng way>, to 
strengthen their partnership xn the instructional improvement process. 

The staff development program used In this study differed in several 
respects tor the training program Included lu A*J*a*a stud/. In his study, 
the 28 teachers who volunteered to participate In the program were provided 
with a two-day workshop on constructing mastery units, objectives, and 
quizzes and w e given access to literature describing the principles of 
mastery leaning. They were then gi\ a the assignment to develop a mnstery 
learning module for one of the study units they would present within the next 
six weeks. In short, the workshop and follow-up assignment constituted the 
entire training program. Following this brief Introduction tv. mastery 
learning, 11 teachers reported that the project was too time consuming aui 
terminated their participation. Arlln observed the classes of the remaining 
17 teachers to d: 'ermine the extent of their implementation of mastery 
learni lg pr edures. On the basis of those observations and follow-up 
discussions with the teachers, he decided that only 10 of the teachers 
adhered sufficiently to rn^tery learning procedures r~ warrant further 
observation. Co „equently, his research findings were based upon his 
subsequent study of less than half of those teachers who originally 
volunteered to participate. 

In covert co \rlla"s brief, one-shot delivery of training, the 
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staff development program developed la this study did noc simply provide the 
participants with access to research findings on effective Instructional 
practices* Rather, teachers were provided with a considerable amount of time 
and support :o assist them in actually applying these practices in their 
instruction. The initial training was presented in an intensive summer 
seminar* In addition, extensive support was provided in the follow-up 
sessions held during the following semester, peer observation and coaching, 
and opportunities for colleglal planning sessions. Furthermore, the 
administrative training program was designed to give both the teachers and 
administrators greater understanding not only of the research-based 
Instructional strategies found to make the greatest difference In studen' 
learning, but also of ways to strengthen their mutual efforts In the 
Instructional Improvement process. 

Ou re* cs suggest that when the design of training activities 
include* provisions for giving teachers sufficient time and support, 
substantial benefits can be reaped in terms of the extent of implementation 
o' the recommended instructional strategies. Whereas les < than half the 
teachers In Arlln's study successfully applied the training they received, 
the teachers who received training in our study allocated, oa average, about 
20 percent of class time to the chief principle of mastery learning (the 
feedback-correct* ve/enrlchment loop) despite the fact that ttu, had devoted 
virtually no time to this Instructional component prior to being trained. 

Furthermore, it should be noted that not only do one 'Shot approaches 
to staff development yield little with respect to the transfer of training, 
but they may also produce / ~>nse of frustration for teachers. For instance, 
in Arlln's study the principal reason cited by those teachers « o terminated 
thel~ participation In the training program was that It required too much 
time, In light of the other Instructional responsibilities that they faced 
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each day* Th*se teachers did not discontinue their participation because 
they rejected the Instructional principles that had been presented In the 
training* On the contrary , these prlnclnles ware consistent with their 
beliefs about teaching and learning, and they acknowledged the value of these 
principles In the effort to provide quality Instruction. Hence, providing 
these teachers with Information on Instructional strategies Intended to 
Increase their students" level of mastery without providing then with 
sufficient time and support to Implement the strategies may have deepened 
their sense of frustration and diminished their professional self-esteem. 

Res arch findings oc teaching have Identified a set of instructional 
strategies that can make an important difference in student learning* Yet, 
if these reaearch-based Ideas are to be translated effectively Into action. 
It is also necessary to take Into account the research findings on effective 
staff development practices. The results of our study suggest that combining 
and using the contributions from these two areas of research In the dt. gn of 
staff development programs can empower, rather than frustrate, classroom 
teachers In their efforts to provide high-quality Instruction. 

Organisational Conditions for Instructional Improvement 

This section discusses the flndlngc pertaining tc the instructional 
leadership support functions and policy issues related to teacher evaluation 
and workload. In addition, the implications of these findings as they relate 
to the organlzatic 1 conditions that support Instructional Improvement in 
secondary schools w*ll be discussed. 



Instructional Leadership Support 

The first factor related to the organizational con'V .Ions of the 
participating schools that we examined was the instructional support teachers 
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received. The relationship between the extent to which the teachers 
Implemented the Instructional strategies presented In the program and the 
amount and usefulness of the sup; rt they received was analyzed. He 
requested the participating teachers to Identify both the types and the 
sources of support they had received In their implementation efforts. The 
results of the analysis revealed that a positive relationship existed between 
the total amount of support the teachers received aud the extent to which 
they applied the instructional strategies. 

This finding has several Implications related to the context of the 
Instructional improvement process 1- secondary schools. First, and perhaps 
\e most fundamental Implication, Is that if support Is not provided. It is 
likely tha* the transfer of training presented In staff development programs 
will be diminished. The findings of our study indicate that when teachers 
receive tupport, the effectiveness of staff development programs Is enhanced 
in terms of tie extent to which teachers Implement the training. 

One possible explanation for this finding is that when school 
administrators give teachers visible and direct support and provide 
opportunities for them to support each other in applying staff development 
training, this conveys a m«»«age that the program is not only consistent with 
the school's goal but also that the teachers' efforts at program 
implementation are considered worthwhile and valuable. Moreover, such 
support forges alliances between teachers and administrators, and among the 
teachers themselves, that strengthen their mutual endeavor to achieve the 
school's goala. 

In the past few years greater attention has been paid to tb« 
Importance of school-based staff development programs. In some Instances 
this has occurred as a result of local initiatives in response to 
recommendations of nation*! reports on ttw status of secondary education, 



l*e* f A Nation at Risk (National Commission on Excellence in Education 1983)* 
In other cases, state mandates have required school districts to develop and 
implement comprehensive staff development programs (i*e. t Illinois School 
Reform Plan, SB 730, 1985). The findings in our study suggest that, as more 
school districts invest greater amounts of time and resources in staff 
development efforts, It would be prudent, even on a cost-benefit basis alone, 
for them to also consider the support system they will need to Implement If 
they are genuinely interested In providing successful staff development 
programs* 

Some of the potential elements of such a support system were 
identified by participating teachers in their listing of the types 
sources of support they considered useful* Among these elements was a clear 
rationale and focus for the program* When program designs include time for a 
description of program goals and a presentation of evidence on its 
effectiveness before training actually begins, teachers are able to appraise 
the merits of the program for themselves* Of all the elements of support that 
were identified, teachers considered this one to be the most important* 
Because the design of the program used in our study Included an explanation 
of program goals and rationale, the teachers recognised at the outset that 
their professional opinions were valued, and th<fty were net simply placed in 
the position of being recipients of H tmthe w related to instructional 
effectiveness* Nor were they charged with the responsibility of blindly 
accepting a set of expectations for their Instructional performance that 
might or might not have been consistent with their own beliefs about teaching 
and learning* Instead, both the dignity of their position and their 
expertise were respected* 

A second source of support the participating teachers considered to 
be of great value was the opportunity to collaborate with their peers* The 
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chance for secondary school teachers to neet with each other In an 
Instructional problem-solving setting Is relatively rare. By fostering 
collaboration, the program may have served to diminish the sense of Isolation 
that teachers In secondary schools often experience. Moreover, It say have 
provided a source of ongoing support that remained long after the training 
program was initially presented. In addition, these opportunities for 
teachers to share with each other their experiences In Implementing the 
program expanded the set of strategies they could employ in applying the 
research-based Instructional principles. 

Another type of support that teachers ranked only slightly below the 
value of the training program Itself was the moral support that their school 
administrators and their colleagues offered them as they Implemented the 
strategies. This finding Is consistent with findings reported In the school 
effectiveness literature (i.e., Purkey and Smltn 1982) that underscore the 
Importance of organisational climate and the culture of school Improvement. 
The multiple sources of encouragement (I.e., from principals, assistant 
principals, department heads, and colleagues) that were provided to the 
teachers In their Implementation efforts helped to affirm the program's value 
and may have established an expectation within the school that greater 
success could be achieved through partnerships in school Improvement* 
Furthermore, the moral support that was offered to the teachers may ha*e not 
only assisted them in implementing the program, but It may tuve also givsn 
them a greater sense of pride about their contributions to the Instructional 
process* 

The teachers also considered the discussion of progrjm applications 
and the actual demonstrations of the instructional strateg; as to have been 

ry useful* In many ways, this simply verifies the elements of good 
pedagogy. For Instance, Rosens hit*'* (1983) analysis of the teacher 
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effectiveness literature Identifies demonstrations of applications of the 
skills or concepts presented In the lesson as being among the principal 
Instructional functions that contribute to student learning* Thus, the 
presentation of the Instructional principles of classroom management and 
mastery learning In the staff development program, along with the thorough 
conslderetlon of how those principles could be applied In the teachers' 
classrooms, may have not only strengthened the likelihood that the teachers 
would Implement the principles, but also It demonstrated an application of 
those principles within the training program Itself. 

Lastly, the Instructional support survey asked the teachers to 
compare the advantages and disadvantages of Implementing the program* The 
data analysis Indicated that those who considered the program to be more 
advantageous Implemented the program to the greatest extent* It Is 
significant th; .one of the 21 participating teachers believed the 
disadvantages of the program outweighed the advantages* Sever in teachers 
reported that th** advantages outweighed the disadvantages. The four teachers 
who Indicated that the ad /ant ages and disadvantages were about equal reported 
In follow-up Interviews that the disadvantages were related primarily to the 
lack of time to Implement the program adequately and were not related to the 
effect of the program on their students' learning* 

The analysis of th* data did not reveal whether the teachers' 
attitudes concerning the program affected their implementation of the 
strategies or, on the other hand, whether their experiences In applying the 
strategies Influenced their perspectives on the program* No* is it clecr 
whet! er the presentation of the program's goals and rationale at the outset 
of training contributed to the teachers' perception of Its value* 
Nevertheless, the findings do suggest that the belief system the teacher 
holds concerning the Instructional process can make a difference In the 




relative success of staff development progress aimed at improving 
Instruction* 

hence, It appears tbst a more enduring Impact of staff development 
programs can be realised when the design of the program takes into account 
the participants" value system* The program design of this study Included 
both direct end Indirect efforts to Influence the teachers' perspectives on 
the value of the program* A direct attempt was made by including a 
discussion cf the program's alms end rationale, and indirect attempts were 
made by attempting to foster conditions within the school that would enable 
teachers to succe i In applying the strategies* These efforts to align the 
teachers" beliefs about teaching and learning with their perspectives ou the 
benefits of the program may have been one of the key factors that contributed 
to the success of the program" s implementation* 



Teacher Evaluation and Instructional Supervision Policies 
Our study also explored the relationship between the extent of 
program implementation and the teacher evaluation and instructional 
supei ision policies of the partlclatlng districts* The schools" 
instructional supervision policies and procedures were reviewed, and the 
teachers" perceptions of the evaluation procedures were analyzed* 

Although the review of the participating districts" teacher 
evaluation policies revet 'ed differences among districts in the criteria 
employed, procedural components, the frequency of evaluations, and the 
supervisory roles related to evaluations, there were nevertheless many 
striking similarities* For instance, all three districts required a 
goal-setting component, yet none of the evaluation procedures provided any 
indicators of what constituted worthwhile instructions 1 , goals or what 
elements were necessary to achieve theme Nor did these sets of procedures 
O 86 

ERIC 90 



offer any clues concerning the nature of the classroom observation data 
collection process or other assessment measures that were used to determine 
whether the specified goals had been met. Furthermore, although each 
district stated that the purpose of the evaluation process was to Improve 
instruction, none of the districts' procedures provided any Indication of how 
teachers would be provided with feedback on their Instructional performance, 
nor were any guidelines or suggestions offered for strategies that could be 
employed to remediate Instructional problems* In short, each district's set 
of evaluation procedures outlined a process whose Inherent design offered 
little hope of providing an accurate characterisation and/or appraisal of the 
teaching and learning encounters that occurred In their schools. 

The most noteworthy finding from the analysis of the teachers' 
perceptions of the evaluation procedures was that those teachers who were the 
most critical of the conditions of the supervision and evaluation processes 
were also those who most frequently implemented the recommenced Instructional 
strategies. Perhaps one explanation for this is that these teachers' 
dissatisfaction with their school's cupervisory process and their perception 
that the process did not fulfill Its goal o* helping teachers to Improve 
instruction led them to search more actively for other means of strengthening 
their instructional performance, and this project's staff development program 
offered them opportunities to do so. Consequently, they may have been more 
open to adapting their instructional techniques by incorporating the 
research-based strategies presented In the program. 

The findings in our study that pertain to the teacher evaluation 
process differ in some respects from those Natrlello (1984) reported. In his 
study he found a positive relationship between certain conditions of the 
evaluation process (frequency of evaluation and amount of Influence over the 
process) ano teachers' self-reports of the amount of leverage they had over 
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their Instructional performance* He characterized Instructional leverage In 
tens of the strength of the relationship between the efforts teachers 
exerted to Improve Instruction and the effect of their efforts on the quality 
of their Instruction* Hence, those teachers who reported that they had 
greater leverage over their teaching were also those who Indicated that their 
efforts to strengthen their Instruction were the most effective. In 
contrast, It should be noted, the findings of this study were derived from 
actual observations of the teachers' Instructional performance rather than 
from '.heir perceptions of the quality of their instruction. When this 
observational data were taken into account a negative, rather than positive, 
relationship was found between the conditions of the supervisory process and 
instructional performance. Thus, although certain conditions of the teacher 
evaluation process may be related to the teachers' sense of Instructional 
efficacy, they are not related to actual Instructional performance. 



The third factor considered In the Investigation of the 
organizational conditions potentially related to the extent of Implementation 
of the Instructional strategies was the teachers' workload. Although the 
analysis of the teachers' workload revealed some significant differences in 
the teachers' overall responsibilities (I.e., number of course preparations, 
range of students' ability levels, number of students assigned to their 
classes, and the amount of time they committed to directing extracurricular 
activities), the findings Indicated that despite these differences, teachers 
with lighter workloads did not implement the Instructional strategies to any 
greater extent than teachers with heavier workloads. Moreover, when asked to 
rate the overall demands of their workloads, those teachers who perceived 
their workloads to be the heaviest were also those who Implemented the 
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strategies to the greatest extent* 

These findings raise a number of questions. First, although certain 
aspects of the teachers' workloads were considerably different, are there 
perhaps other dimensions of their workload that might have been related to 
the extent to which they Implemented the program? These dimensions might 
Include the number of classes assigned, the amount of conference and planning 
time available to accommodate colleglal team planning, or the amount of tine 
assigned to supervisory responsibilities* If there had been different in 
these factors, would a relationship have been detected? 

Second, did the design of the staff development program have 
sufficient strength to overcome the conditions of the teachers' workloads 
that might otherwise have been a deterrent to their implementation efforts? 
For Instance, did the support system built Into the program design counteract 
the possible negative effect of preparing Instructional plans for a greater 
number of courses and teaching larger classes of students with varying 
ability levels? If such a support system had not been provided, would It 
have made a difference? 

Lastly, did those teachers who considered their workloads to be the 
heaviest hold role definitions for themselves that differed from those their 
colleagues held? Had they established expectations for themselves that 
Included the commitment of greater amounts of time and energy to their work? 
Since those nho perceived that their workloads *sre heaviest Implemented the 
strate<*es to the greatest extent, did these teachers do so because they 
considered it their professional responsibility to exert a greater amount of 
effort In implementing the instructional strategies presented In the program? 

The answers to these questions cannot be determined by analysing the 
data collected In our study, which points to some of its limitations* 
However, these limitations raise soma issues that subsequent research efforts 
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research In this area. 
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Recommendations for Future Research 

In this project, findings from the research on lsntructlon and on 
effective staff development practices were Incorporated In the design of a 
staff development program for secondary school teachers and administrators. 
An experimental test was conducted to determine the model's effectiveness in 
terms of the extent of prograir Implementation. The study also investigated 
the relationship between certain organisational conditions and program 
Implementation. The results of the research project provide evidence of the 
program's effectiveness and reveal the degree of the relationship between the 
effectiveness of the program and the organizational factors that were 
exami ned. 

However, the results do not provide a comprehensive analysis of the 
staff development program. It should be noted that the findings can be 
generalised only to a similar sample. Additional studies need to be 
conducted that Include Instructional programs at various grade levels and 
other content areas. Whether or not staff development programs that combine 
training in classroom management and the Instructional principles of mastery 
learning are an effective means for improving instruction in other content 
areas or at different grade level? has ~*et to be determined. 

Furthermore, the design of the program was drawn from a selected set 
of findlr~«* from the research on Instruction and the research on effective 
staff development practices. Additional sets of research findings need to be 
considered in the design of future studies. For Instance, perhaps the 
combination of the results of Slavin'a (1980, 1983a, 1983b, 1984) work on 
ir^reasin^ student Incentives and motivation for learning through cooperative 
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teamwork, along with the findings from the research on mastery learning and 
classroom management, would yield a more comprehensive set of Instructional 
strategies that could be Incorporated In the design of staff development 
programs* 

In addition, further research Is needed to examine more critically 
the context of the Instructional Improvement process* Findings from the 
research on effective schools consistently underscore the value of the 
culture of improving schools, yet the factors that have the most profound 
influence on the school's culture have not been determined* In this study 
only three factors were examined* Mot only is further research required to 
gain a better understanding of the relationships among factors that 
contribute to the school's culture and instructional Improvement, but other 
organizational conditions of schools need to be considered as well* For 
instance, would any differences have been detected in the strength of the 
relationship between the extent of implementation of the staff development 
program and the teachers' workloads had there been greater variance In the 
teachers' instructional responsibilities, such as the number of classes they 
taught or the amount of time they were regularly provided to meet with their 
colleagues in team planning sessions? Or, what if the goal-setting component 
of the teacher evaluation procedures were directly linked with a 
comprehensive professional development program, including staff development 
opportunities provided to teachers? Did the fact thai: administrators of the 
participating schools were Involved in the program Influence the r mount of 
support they extended to the teachers in their implementation efforts? What 
other organisational conditions might have enhanced or hindered the 
effectiveness of the staff development program? The answers to these 
questions could not be obtained from the data collected for this study* A 
broader and more in-depth investigation of the organisational conditions that 
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contribute to the effectiveness of staff development programs needs to be 
considered In subsequent studies. 

Finally, additional research oust be conducted to explore the full 
range of Implications of the findings from the research on effective staff 
development practices In relation to the organizational framework of the 
school and to the policies that shape key decisions affecting the improvement 
process. Clearly, advances In our understanding of effective Instructional 
practices will not lead to comparable gains In student learning unless 
thoughtfully designed staff development programs are provided to assist 
teachers in applying these Instructional strategies, and until the conditions 
of secondary schools serve to expand, rather than restrict, the capacity of 
the school to Improve its Instructional program* 
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Appendix A 



INSTRUCTIONAL FUNCTIONS TIME ALLOCATION 
OBSERVATION INSTRUMENT 



The preparation of these materials was made possible 
through an Institutional Grant awarded by the National 
Institute of Education to the Center for Educational 
Policy and Management. 



Kathleen A, Fitzpatrick 
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INSTRUCTIONAL FUNCTIONS TIME ALLOCATION OBSERVATION INSTRUMENT 
Guidelines for Classroom Observers 

Cover Sheet : Please complete the items on the cover sheet prior to the 
beginning of the class period in which the observation Is to be conducted. 
These items Include the date, yocr name, the teacher's name, the school and 
district, the title of the course, the number of students In the class on that 
day, and the time class begins and ends. This Information Is collected for the 
sole purpose of organizing and managing the data collection process. The names 
of the Individual teachers observed will not be contained In any reports con- 
cerning the data collection procedures. 

Cla ssroom Observation Coding Procedures : The classroom observation Instrument 

has been designed to assess the extent of Instructional time that Is allocated I 

to various teaching functions. The definitions of these functions are outlined 

below. During the classroom observation period note the teaching function that 

has been fulfilled within one-minute Intervals of class time by circling the 

letter representing the particular function. At the five minute Intervals the 

number of students who are off-task should be recorded In the appropriate space 

on the observation Instrument. 
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Definitions of Codes 



Code Event t Definition 



T 


Transition 


Transition time is the time that occurs between 
classroom events as the lesson shifts to the next 
stage. 

Ex. following the review of the previous day's 
lesson the teacher requests that students open their 
notebooks while he/she organizes the materials needed 
for the presentation of the new lesson. 


N 


Nonacademic 
interaction or 
interruption 


Code N is recorded for instructional time that has not 
1 been focused on the content of the lpccnn Fvamr>i«< 
of these events Include times when the lesson Is 
interrupted and when nonacademic Interaction occurs. 

Ex. teacher corrects misbehaving student; discussion 
1 of social or non-content related topics; teacher is 
called to the door to receive a message; announcement 
is read on the PA svstMi. 


— 


Number of students 
off-task 1 


At five minute intervals the number of students who 
are off-task is recorded. Examples of student off-task 
behaviors include the following: misbehaving, inappro- 
priate classroom behavior; waiting for the teacher 
to get assistance; interim activity,. such as sharpening 
a pencil. 


R 


Review 


Code R is recorded for the review of the previous 
lesson or homework assignment. 


H 


Collect Homework 


Code H is recorded when the teacher collects the 
students' homework assignments. 


Q 


Quiz 


Code Q is used when the teacher administers a quiz to 
assess the students' understanding of material that 
has been previously presented in class. 
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Code Event 



Development 



Guided Practice 



Definition 



Code D is recorded when the teacher presents a new 
lesson. The code is used for instruction and 
explanation of new skills or concepts* 

Code P is used when the students are given the 
opportunity to apply the new skills or concepts 
presented in class under the supervision of the 
teacher* During guided practice students are given 
assistance by the teacher and an explanation of 
each exercise is provided. 



Formative 
Assessment 



Feedback 



Rt 
Rm 
Rp 



Et 
Em 



Reteaching 



Enrichment 



Code A is recorded when the teacher assess the 
students understanding of the material presented in 
class. The assessment process could include both 
paper and pencil , and oral quizes. 

F is recorded when, on the basis of the students 1 
scores on the formative test, students are informed 
of their progress and are directed to alternative 
learning opportunities, or are permitted to begin 
assignments providing independent practice of the 
skills and or concepts presented in the lesson. 

Code R if reteaching or corrective instruction is 
provided to those students identified as needing 
assistance on the formative assessment of progress. 
Circle Rt if the reteaching is teacher-led, Rm if the 
student is given assistance through instructional 
materials, or Rp if the student obtains assistance 
from a peer tutor or classroom aide. 

Code E if students are provided enrichment or 
extension learning activities. Circle Et if the 
activities are teacher led, or Em is the students 
are working primarily with instructional materials. 
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Code 



Event 



Independent 
Practice 



Other 



Definition 



Code I when students are engaged in assignments 
providing independent practice of the skills and or 
concepts presented in the lesson. Circle I (+) if 
the teacher monitors their work, otherwise simply 
circle I. Independent practice opportunities 
include the assignment of homework. 

Circle 0 If none of the above categories describes 
the Instructional event that has occurred. If the 
event Is non-academic and/or not related to the 
content of the lesson being presented In class 
circle N. At the conclusion of the observation 
period provide a written description of any 
Instructional events that have been designated as 
"other" on the summary sheet attached to the 
Instrument. 



♦Note: In some cases additional learning opportunities may be provided to some 
students In the form of reteaching, while other students are given enrichment 
learning activities or are assigned independent practice exercises to complete. 
In such cases, when more than one instructional event simultaneously occurs, it 
is appropriate to code each instructional event at the time that it occurs. 
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Instructional Functions Time Allocation 
CLASSROOM OBSERVATION FORM 

Your Name: Date: 

Teacher's Name: School: 



Title of Course: District: 

No. of students In class today: 

Time Class Begar: 

Time Class Ended: 



The preparation of these materials was made possible 
through an Institutional Grant awarded by the National 
Institute of Education to the Center for Educational 
Policy and Management. 

Kathleen A. Fitzpatrick 
3/84 
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Instruct km I faction Tin* Al loc.Ua. 



CUS9DQN OBSERVATION IN5TRKKT 



Event 










"ROT 






transition 

Nonecadsvk Interaction 
Hater of students off-Usk 














fl 


B 


fl 


I 


1 


1 


T 


T 






tori* 

Collect HomsMtyt 


R 
N 
Q 


R 
H 
Q 


R 
H 
0 


R 

H 
0 




R 

H 
0 


R 

H 
0 


R 

H 
0 


R 

H 
0 




R 
H 
0 


R 

II 

q 


R 

H 
0 


R 
H 
0 






fcvelapmt 
Practice 


0 
P 


0 
P 


0 

p 


0 

p 




0 

p 


0 

p 


0 

p 


0 

p 




0 

p 


0 

p 


0 

p 


0 

p 






Fonmrtlve Assessment 

Fee*** 

Retorting 

t • teacher led 

■ • arteritis 

P " peer tutor or tide 
Enrich ub it 

t -teacher led 

m • materials 


A 

F 

Rt 
to 
*> 

Et 
Em 


A 

F 

Rt 
to 
Rp 

Et 
Em 


A 

F 

Rt 
to 
* 

Et 
Em 


A 

F 

Rt 
to 

Rp 

Et 
to 




A 

F 

Rt 
to 

Rp 

Et 
Gm 


A 
F 

Rt 
to 

Rp 

Et 
Cm 


A 

F 

Rt 
to 

Rp 

Et 
to 


A 

F 

Rt 
to 

RP 

Et 
to 




A 

F 

Rt 
to 

Rp 

Et 
Cm 


A 
F 

Rt 
to 
* 

Et 
to 


A 
F 

Rt 
to 
Rp 

Et 
to 


A 
F 

Rt 
to 

«P 

Et 
to 






Independent Practice 
Other 


I ♦ 
0 


I ♦ 
0 


1 ♦ 
0 


I ♦ 
0 




I ♦ 
0 


I ♦ 
0 


I ♦ 
0 


I ♦ 
0 




I ♦ 
0 


!♦ 
0 


I ♦ 
0 


I ♦ 

0 







Event 


16:0 


! 17-n 


Iff- 


m 


7M 


TTrfl 


1 77 1 


m 


71 


75TJ 


} XI 












Transition 

fenecadanrfc Interaction 
After of students off-Us* 


T 

N 


T 
N 


T 
N 


T 

n 




T 
N 


T 
N 


T 
If 


T 
N 




T 
N 


jm 

T 
M 




II 3:H 

T 
N 


JO:OC 


i 


Hevle* 

Collect tomswork 
Quiz 


R 
H 

0 


R 
H 
0 


R 
H 
0 


R 
H 
0 




R 
H 
0 


R 

N 
0 


R 

H 
0 


R 

H 
0 




R 
H 
Q 


R 
M 
0 


R 
H 
0 


R 
H 

0 






development 
Practice 


0 
P 


0 

p 


0 

p 


0 

p 




0 

p 


0 

p 


0 
P 


0 
P 




0 
P 


0 
P 


0 

p 


0 

p 






tormrtlve Assessment 

Ftaobacfc 

toUechlng 

t • teacher led 

• • materials 

P*P«er tutor or aide 
tori dim it 

t • tmacher led 

m • materials 


A 
F 

Rt 
to 

RP 

Et 
Em 


A 

r 

Rt 
to 
*> 

Et 
Em 


A 

F 

Rt 
to 
*> 

Et 
Em 


A 

F 

Rt 
to 
* 

Et 
to 




A 

F 

Rt 
to 
* 

Et 
to 


A 

F 

> 

to 

RP 

Et 
to 


A 

F 

Rt 
to 

Rp 

Et 
to 


A 

F 

Rt 
to 
Rp 

Et 
to 




A 

F 

Rt 
to 
* 

Et 
to 


A 

F 

Rt 
to 
Rp 

Et 
to 


A 

F 

Rt 
to 
Rp 

Et 
to 


A 

F 

Rt 
to 
Rp 

Et 




I COPY AVAILABI 


^dependent 
(fcner 

— o 


I ♦ 
0 


I ♦ 

0 


1 ♦ 
0 


1 ♦ 
0 




I ♦ 
0 


1 ♦ 
0 


I ♦ 
0 


I ♦ 
0 




I ♦ 
0 


I ♦ 
0 


I ♦ 
0 


I ♦ 
0 


* 





Event 




35:0(5 




in *Mi»^:iimV:goim*g™^^ 


1 45:0T 


IMOer of students off- Us* 


i 

W 


T 
1 

ft* 


T 
H 


T 
M 






1 


a 


fl 


1 


B 


B 


B 


B 








tovie* 


K 


R 


R 


ft 




• 


ft 


R 


R 




R 


R 


R 


R 








Col lfcTt thwRJJk 


u 
n 


y 
n 


N 


N 






N 


N 


N 




H 


N 


N 


M 








Quiz 


n 
V 


A 

V 


Q 


0 






Q 


Q 


Q 




Q 


Q 


Q 


Q 




— 1 








































0**elop*ent 


0 


0 


0 


0 




0 


0 


0 


0 




0 


0 


0 


0 










r 


r 


P 


P 






P 


P 


P 




P 


P 


P 


P 






































ft 


Fonnitlte As sswt 


A 


A 


A 


A 






A 


A 


A 




A 


A 


A 


A 








Feed** 


F 


F 


F 


F 






F 


F 


F 




F 


F 


F 


F 




S 


Ml 


RetAxning 


































3 


t - teacner ted 


ft 


Rt 


Rt 


Rt 




Rt 


lit 


Rt 


Rt 




Rt 


Rt 


Ri 


Rt 




CO 


* • miterljls 


An 


An 


to 


IN 




Hi 


to 


to 


to 




to 


to 


to 


to 








P ■ pw tutor or aloe 
Enn droit 


Rp 


Rp 


*> 


Rp 




* 


* 


* 


*» 




Rp 


Rp 


Rp 


RP 








t • uxher led 


Ct 


Ct 


Et 


Et 




Ct 


Et 


Et 


Et 




Et 


Et 


Et 


Et 








• ■ miterlals 


Em 


Em 


Em 


to 




6m 


to 


to 


En 




Em 


Em 


Cm 


Em 








Independent Practice 
Other 


I ♦ 

0 

I 


I ♦ 

0 


1 ♦ 
0 


I ♦ 
0 




I ♦ 
0 


I ♦ 

0 


I ♦ 
0 






I ♦ 
0 


I ♦ 

C 


I ♦ 
0 


I ♦ 
0 







Event 



Transition 

tonjCJdamlc Interaction 
hrtxr of sUxmnts off-usk 



fttvle* 

Collect Urocele 
Quiz 



Oewlcpnarrt 
Practice 



Format 1* AssessnjTt A 

fevfcic* p 
ft* teaching 

t • teacner led Rt 

m • materials to 
p • peer tutor or aide ftp 
Enncfrert 

t ■ teacher led Ct 

m • nuteriah Em 
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A 

F 

Rt 
to 
Rp 

Ct 
Cm 



I ♦ 
0 



A 

F 

Rt 
to 

Rp 

Ct 
Em 



I 4 

0 



A 

F 

Rt 
to 

Rp 

Ct 
Cm 



1 ♦ 
0 



£0:00! 51:00 



53:001 54:00 



A 

F 

Rt 
to 

Ct 
Em 



5 ♦ 
0 



A 
f 

Rt 
to 

*> 

Et 
Em 



I ♦ 
0 



A 
F 

Rt 
to 
*> 

Ct 
Em 



I ♦ 
0 



A 

F 

Rt 
to 
RP 

ct 



i ♦ 

0 



5 7 :001 58:00 
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R 

H 
V 



A 

F 

Rt 
to 

Rp 

Ct 
Em 



I ♦ 
0 



A 

F 

Rt 
to 

Rp 

Ct 
Ejn 



A 

F 

Rt 
to 

Rp 

Ct 
to 



I ♦ 
0 



A 
F 

Rt 
to 
Rp 

Ct 
Cm 



f ♦ 
0 



Observer's Name: 
Date: 



Time of observation: 



SUMMARY SHEET 

1. Total number of times Instructional Events were coded 



Instructional Event 


Code 


Number of times 
event occurred 


% of time event 

nrrtirroH 


Transition 

Nonacademlc Interaction 


T 






N 






Review 

Collect Homework 
Quiz 


R 






H 






o 






Development 
Guided Practice 


D 






r 






Formativr Assessment 

Feedback 

Reteaching 

teacher-led 

materials 

peer tutor or aide 
Enrichment 
teacher-led 
materials 


A 







F 






Rt 






Km 






l>P 






Et 






Em 






Independent Practice 
Other 


I ♦ 

0 


I « I ♦ * 


I • . I ♦ 



2. Total number of students who »:re off-task durl g the Instructional 
period. 

3. Total number of students In class. 

4. Percentage of students off-task 

5. Describe any Instructional events that were designated as "other" 
during the observation period. 
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Appendix B 



SURVEY OF TEACHERS' PERCEPTIONS OF 
SUPPORT FOR INSTRUCTIONAL IMPROVEMENT 



(Note: With permission Items 1. 2, 3, and 4 of the survey are adaptations 
of Items conta* jd In the User Questionnaire designed by THE NETWORK for 
their project entitled "A Study of Dissemination Efforts Supporting School 
Improvement Loucks 1980.) 
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name: 



Below Is a set of questions which asks for some Information concerning your use of the research 
based instructional strategies which have been presented In the staff development program. 
Your assistance In providing this Information Is most appreciated. All responses will be 
maintained on a confidential basis. 



1. To what extent do you feel the advantages of using the instructional strategies presented 
In the staf* development program outweigh the disadvantages? 

Check the appropriate statement. { > 

The advantages outweigh the disadvantages. 

The advantages somewhat outweigh the disadvantages. 

The advantages and the disadvantages are about equal . 

The disadvantages somewhat outweigh the advantages. 

The disadvantages outweigh the advantages. 

2. Check the appropriate boxes below to Indicate the frequency of assistance provided to you 
in implementing the Instructional strategies and how useful you. found the assistance. If 
not applicable to you* leave the row blank. 



Person 


THIS PERSON ASSISTED: 


I FOUND THEIR ASSISTANCE: 


Not at all 


Sometimes 


' Frequently 


Not useful 


Useful 


Very useful 


Principal 












\ 


Assistant Principal 














Fellow Teachers 














Department Head 






m 








Superintendent 














Assistant Superintendent 

or other central office staff 






1 






• 


External Resource Person 














OTHER: 

RJC 
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J. Is there one person in your district who has been the most active in helping to implement 
the research* based instructional strategies? 

Include yourself in considering the question. Yes 

Mane r 

Position: 

. Below is a list of different tyoes of assistance that might have been provided to you 
in connection with implementing the research-based instructional startegies and possible 
providers of this assistance. Enter the appropriate number in each box to indicate 
your response. 

Put a 0 in the box if the person did not provide any of that type of assistance. 

Put a 2 in the box if the person provided that type of assistance, but it was not 
useful. 

Put a 2 in the box if the person provided that type of assistance and you found 
it useful . 

Put a 3 in the box if the person provided that type of assistance and you found it 
very useful. 



Types of Assistance 


Princ. 


Asst. 
Princ. 


Supt. 


Asst. 
Supt. 


Fellow 
Teachers 


Dept. 
Head 


External 
Resource 
Person 


Other 


a. Training in using the 
research-based 
strategies 


















b. Opportunities to 
observe the instruc- 
tional practices in 
use 


















c. Moral support for try- 
ing to implement new 
strateqies 


















d. Availability of 
materials 


















e. Opportunity for Prob- 
lem-solving session* 


















f. Help in securing 
resources (release 
time, aides* equip- 
ment, etc.) 


















g. Information concern- 
ing the goals and 
focus of the instruc- 
tional straoeties 


















h. Information about 
applying the 
strategies in my 
class 

rJc 






X 


13 j 











-J- 



Types of Assistance 


Princ. 


Asst. 
Princ. 


Supt. 


Asst. 
Supt. 


Fellow 
Teachers 


Dept. 
Head 


External 
Resource 
Person 


Other 


1. Information about the 
impact of my efforts 
to apply the strate- 
gies in my class 


















j. Other: 

• 



















5. Are there any types of assistance that have not been available to you but could be useful 
in your effort to Implement the research-based instructional strategies presented In the 
program? 



No 

If you responded "yes," pleas* describe the type(s) and source(s) of this assistance. 



6. Have there been any hindrances or obstacles to your efforts to apply the research-based 
instructional strategies? 

Yes 

No 



If you respond "yes," please describe the nature of these obstacles and your recommendations 
for either eliminating them or diminishing their negative Influence. 
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Appendix C 
















It would be most appreciated If you would take a few aoaents to covlete thl. murv „ 

be maintained on a confidential ba.la. Thank you for ySftiS! iT^S^ iTSS £1™*°™' '° 

Name: 




SURVEY OP TEACHER EVALUATION PROCEDURES 












It Please indicate the number of time 
assigned supervisory responslblllt 




Building Level: 


no re 

than 

3 t lmes/year 


3 times/ 
year 


2 times/ 
year 


1 time/ 
year 


Once 
every 
other 
year 


Once 
every 
two 
years 


Once 
every 
three 
years 


Less 

than once 
every 
3 years 


Nona* 

or doe 

QUI 

Apply 


Principal 




















Assistant Principal 

Department Chairman or Division Head 








































Teacher Peer Supervisors 


























































- 






















District Level: 

































Assistant or Associate Superintendent 
Director of Personnel 








































Director of Instructional Services 
Others* 
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* 
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Place a check In Zhe appropriate apace to Indicate the coc^onents that are 
Included In the evaluation procedures <»nployed by your district. 

Sources of Information Gathered to Determine the Evaluation of Teachers' 
Performance: 

Supervisor's rating of teaching performance on the basis of 

criteria established for the evaluation of all teachers. 

Supervisors' rating of teacher's performance of non-teaching 

responsibilities according to a general set of expectations 
established for all teachers. 

Supervisors' rating of teacher's progress on Individually selected 

Instructional goals* 

Supervisors' rating of teacher's performance of non- aching 

responlbllltles on the basis of expectations that at . unique to the 
teacher's position. 

Data gathered from supervisors' observation of teacher's 

Instructional performance. 

Student achievement test data. 



Parent evaluations of teaching perfomrnace. 

Student evaluations of teaching performance. 

Peer evaluations of teaching performance. 

Teacher's self-evaluation of Instructional performance. 

Other: 



Procedural Elements: 

Pre-conference (meeting between supervisor and teacher prior to the 

observation of the teacher's class). 

Formulation by supervisor and teacher of Individual goal(s) to 

strengthen the teacher's Instructional performance. 

. Prior notice of date and cime of classroom observation. 

Classroom observation. 

Supervisor's completion of rating form or checklist during 

classroom observation. 

Supervisor's collection of observational data related to 

p re-determined instructional goal. 



Conference between t etcher end supervisor to dl tones evaluation 
of teacher's Instructional performance. 

Completion of formal evaluation report* 
Other: 



Do the outcomes of the evaluation process effect . uchera* ealarlee? 

Do the outcomes of the e velvet ion process affect any other type of 
recognition of the quality of the teacher's Instructional performance? 
If so, what type of recognition le provided? ' 



Please circle the appropriate number to Indicate your response to the 
following questions. (1 - little or none; 5 - significant amount) 

A. How much Influence do teachers In your 1 2 3 4 5 

district have over the process of the 
evaluation of their Instruct lonal performance? 

B» To what extent doee the evaluation process 1 2 3 4 5 

recognise the teaching responsibilities 
and concerns of each teacher? 



C. How much assistance In Improving the 12 3 4 5 
quality of Instruction le provided to 

teachers through the evaluation process? 

D. To what extent do the outcomes of the 1 2 3 4 5 
evaluation process rely on objective data, 

rather then subjective judgments? 



Rate the overall quality of the feedback regarding instructional 
performance that la provided to teachers through the instructional 
supervisory process by circling the number below which describee It. 

1 2 3 4 5 

general Specific 
vague clear 

Doee the instructional supervision proceee provide direction and support 
for Individual teacher i tot 



a. Improve areaa of weaknesses In their teaching performance? 

b. etrengthen the quality of their performance? 
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Briefly describe whet you believe ere the elms of the evaluation 
procedures alloyed by your district. 



Are the alms of the teacher evaluation process fulfilled In practice 
Explain your response* 



In your estimation what Is the greetest strength of the evaluation 
process? 



a. Whet Is the aost serious weakness of the evaluation process? 



b. How could this weakness be overcome? 
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Appendix D 



Name: 



Date: 



Survey; Teacher Workload 

Pleaae respond to tbi quest lona belov pertaining to your workload this year. Your 
responses will be maintained on a confidential basis. 



1. How many classes do you teach each day? 1. 

2. What la the amount of tine allocated for 

each class? 2. minutes 

3. How many different course preparations are 

you assigned? 3. 

4. Pleaae Indicate the grade and ability levels of the claaaea you 
are teaching this year by completing the following chart. Code 
your responses by selecting the umber 9, 10, 11, or 12 to 
Indicate grade level, and the lettera H, A, or L to Indicate 
honora, average, or low ability classes. If the class contains 
students of ■ore than one grade or ability level, please Indicate 
so. Also, pleaae Hat the total number of atudents enrolled 

In each class on the last column. 



Course Tide 


Grade Level(s) 
9,10,11, or 12 


Ability Level <•) 
H, A, or L 


Total f of 
Students 


1. 








2. 








3. 








«. 








5. 









5. What Is the amount of time available to you 
during the school day for planning and course 
preparation? (I.e., "conference and planning 

time") 5. minutes/day 

6. How Bwch tlue during the school day are you 
assigned to non-Instructional duties? (i.e., 
hall duty, cafeteria supervision, study hall 

monitoring) 6. minutes/day 
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7. 



8. 



9. 



What Is the Mount of tine each week you are 
Involved 1m eponeored echool activities outside 
of the refalar school hours? (I.e., coaching 
responsibilities, club sponsorships) 7. 

Is releaae time or compensation for time spent 
beyond the required echool day hours provided 
to complete work on cu rlculun development 
and 1 net Actional Improvement projects that 
have been designated by the district and/or 
school? 8. 

If your response to Item #8 was "yes," please 
rate the level of support that Is provided 
by checking your response* 9. 



hours/week 



Level of Support : 



Insufficient 
^adequate 
_generous 



10. In addition to your teaching assignment and possible Involvement In the 
extracurricular program please describe any other responsibilities 
you are expected to fulfill In your position. 



11. Please rate the overall demands of your 
workload by checking your response. 



11. 



_llght 
manageable 

Jheavy 



ll6 
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